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FOREWORD 


THE PRESENT book, together with its companion volume devoted to 
the differential and integral calculus, contains the fundamental part 
of the material dealt with in the larger courses of mathematical 
analysis. Included in this volume are general problems of the theory 
of continuous functions of one and several variables (with the 
geometrical basis of this theory), the theory of limiting values for 
sequences of numbers and vectors, and also the theory of numerical 
series and series of functions and other analogous infinite processes, 
in particular, infinite continued fractions. 

Chapter I, “The arithmetical linear continuum and functions 
defined there’ (authors: L. A. Lyusternik and Ye. K. Isakova), 
is devoted to real numbers, the arithmetical linear continuum, li- 
miting values, and to functions of one variable. The material of this 
chapter is more or less that which is usually called the introduction 
to mathematical analysis. 

Chapter I, “n-dimensional spaces and functions defined there” 
(L. A. Lyusternik), effects the transition from functions of one 
variable to functions of n variables, which, geometrically, corresponds 
to the transition from the arithmetical linear continuum to n-dimen- 
sional space £,,, the fundamental theory of which is given. §1 is devoted 
to the fundamentals of n-dimensional geometry and, in particular, 
of the theory of orthogonal systems of vectors in E,,, which serves 
as a simpler model for the theory (Chapter IV) or orthogonal systems 
of functions. §2 is devoted to limiting values in E,, to continuous 
functions of n variables and their systems (transformations in E,). 
In this chapter also §3 deals with a subject which plays an important 
part in pure and applied mathematics, the theory of n-dimensional 
convex bodies. 

Chapter Il, “Series” (authors G. S. Salekhov and V. L. Danilov), 
consists of the theory of series and practical methods of summation. 

The theory of numerical series is dealt with in §1 including ques- 
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tions relating to infinite products, double series and the summation 
of convergent series. Side by side with the classical material the reader 
will find new results about the general tests for the convergence of 
series and estimations of the remainder. 

The more important classes of series of functions are considered 
in §2: power, trigonometrical, and also asymptotic power series, 
and their convergence. At this point some methods for the general 
summation of divergent series are added. In §3 are to be found various 
devices useful in calculations connected with the theory of series. 

Chapter IV “Orthogonal series and orthogonal systems” (authors 
A. N, Ivanova and L. A. Lyusternik), contains the general problems 
of the reduction of functions to orthogonal (and also biorthogonal) 
series. Here, also, general orthogonal systems of polynomials and 
the classical systems of Legendre, Chebyshev, Hermite Polynomials, 
and others, are considered. 

Chapter V “Continued fractions” (author A. N. Khovanskii), 
deals with that branch of analysis which occupied the attention 
of the greatest mathematicians of the eighteenth and nineteenth 
centuries, but which was afterwards unjustly forgotten. Continued 
fractions did not find a place in the contemporary larger courses of 
analysis; on the other hand comparatively recently, some elements 
of the theory of continued fractions were studied even in middle 
school. In the past few years the interest in continued fractions has 
revived in connection with their application in computation and 
other topics in applied mathematics. 

Chapter VI, “Some special constants and functions” (authors 
L. A. Lyusternik, L. Ya. Tslaf and A. R. Yanpol’skii), has more of 
the nature of a manual (in the narrow sense of the word). The mate- 
rial here concerns various constants, the most important systems 
of numbers, including Bernoulli and Euler numbers, some discon- 
tinuous functions, and the simpler special functions (elliptic integrals, 
integral functions, the gamma and beta functions, some Bessel 
functions, etc.). These functions, together with orthogonal polyno- 
mials, after the elementary ones, are the most widely used in appli- 
cations of mathematics, We would like to mention that these special 
functions will be dealt with more fully and in the complex domain 
in one of the following issues. 


CHAPTER I 


THE ARITHMETICAL LINEAR 
CONTINUUM AND FUNCTIONS 
DEFINED THERE 


§ 1. Real numbers and their representation 
1. Real numbers 


All real numbers can be split into two classes: rational and irra- 
tional, All integers and fractions (positive, negative and zero) are 
rational numbers, while the remaining numbers are irrational. 

The set of all rational numbers is everywhere dense, i.e. between 
any two distinct rational numbers a and 5 (a<d) there is at least 
one further rational number c (a<c<5), i.e. in fact, an infinity of 
rational numbers. 

Examples of irrational numbers are: /2= 1-41421356..., a= 
= 3-14159...,¢e =2-7182818...— the base of natural logarithms, and so 
on. Irrational numbers consist of algebraic and transcendental numbers, 
Algebraic irrational numbers are defined as all non-integral real 
roots of the algebraic equation 


X* 4 ayx T+ + dn iix tay = 0, 


where a, (i= 1, 2,...,m) are integers; for example, the roots 
x = 4/10, x = /8 of the equations *—10 = 0, x*~—8 = 0, the 
roots of the equation x5 — 3x4 — 2x3 + x?+ 1 = 0, andso on. The remain- 
ing irrational numbers are described as transcendental; examples 
of these are 2, e, e*, re, log n (where 7 is any integer not equal to 
10*) and so on. 
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2. The numerical straight line 


We choose on a straight line E,, an origin of measurement — the 
origin of coordinates 0, a scale the unit of length, and a direction — 
the orientation. We associate with every real number x a point A(x) 
on the line £,, having the coordinate (abscissa). x, conversely, with 
every point A(x) on £,, we associate a real number x — its abscissa. 
E, is called a numerical straight line or a one-dimensional coordinate 
space (see Chapter II for n-dimensional coordinate spaces £,). 

The number 

—a for a~<0O, 
lal = | a for a=0 


is called the absolute or numerical value of the number a. 
The following relationships hold: 
ja+b| = |al+|5|, 
ja—b| = ||a|—|4]|, 


|. | =|a|.|5}, 
il-b 


The number [a—b] is called the distance between the points a and 
b on the straight line E, (see Chapter II, § 1, sec. 1). 


3. p-adic systems 


Every real number is expressible as a decimal fraction, i.e. has a 
definite expansion in the decimal system of numeration. The decimal 
system is a particular case of a positional system to the base p, where 
any positive integer p > 1 can betaken as the base. The numbers 
0,1, 2,..., p—1 are called the digits of this system, while p* 
(k = 0, +1, £2, ...) are units of the kth order in the system. 

Every positive integer N is uniquely expressible in the form 


n 
N = agp°+a,p'+...+anp" = Yaip, (1.1) 
tad 
where a; are digits. Equation (1.1) is written as 


N = GpQp_-1An—2 - «2p. (1.14) 
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Similarly, any positive real number S, rational or irrational, is 
expressible as a fraction to the base p: 


n 


S= Y ap, (1.2) 


h=—oo 


which is written as 
S = ApAyn—y- « -4yQq, T_14_-pA_g-.- - (1.24) 


If Sis an irrational number, it is uniquely expressible by an infinite 
non-periodic fraction to the base p of the form (1.2) (or (1.2’)). 

If S is rational, it is expressible as an infinite periodic fraction to 
the base p, e.g. the number S = 1/6 is written in the decimal system 
as 

S = 01666... = 0°1 (6). 
In the binary system, S = 1/6 is expressed by the infinite fraction 
1 1 


Rational numbers to the base p are numbers expressible as fractions 
with denominator p* (k = 1, 2, —2:...); each such number has two 
forms in the system to the base p: one with 0 repeated, the other 
with p—1 repeated. 


1 : F : 
For example, the number S = 3 is written in the binary system as 


S = 0°1000... = 0°10), 
S=0O0111...= 0-0); 
and in the decimal system as 
S = 0:5000 ... = 0°5 (0), 
S = 0°4999 ... = 0°49). 
Having selected one of these forms for rational numbers to the 
base p, say the first — with 0 repeated, we obtain a unique form for 


rational numbers to the base p as infinite periodic fractions to the 
base p, and at the same time a unique form for every real number. 


The elements of various p-based systems were to be found in antiquity in diffe- 
Tent nations, and traces have been preserved into modern times in certain 
languages, e.g. of p = 12 (dozens and grosses), p = 20 (traces of this system have 
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been preserved in French), p = 40 (“forty times forty” refers to number of chur- 
ches in Moscow (Trans.)), etc. The system to the base 60 was well developed; it 
originated in ancient Babylon (traces are retained in measurement of angles and 
time). The 60-base system must have competed with the decimal in the Middle 
Ages in the Near East and Central Asia. The decimal system originated in 
India, was further developed in Central Asia, and passed from there into 
Europe. 


At the present time the binary system is widely used in computers 
(together with the related systems having powers of two as base: 
p = 2k, k > 1 an integer). A system of numeration to the base three 
is used in the Moscow State University “‘Setun” computer, A set of 
numbers different from 0, 1, 2,..., p—1 is occasionally used for 
the p digits of the system to the base p. For instance, a convenient 
choice of digits in the system to the base 3 is —1, 0, 1. The digits 
~1i and 1 can be used in the binary system. 


Non-homogeneous positional systems are more general; here, the ratios of 
units of different orders are different numbers. Such systems were used (before 
the introduction of the metric system) for representing ‘‘denominate” numbers, 
ie. for representing magnitudes such as length, weight, etc. For example, the 
following system of units was used for measuring weight in pre-revolutionary 
Russia: 1 pud (+16 kg) = 40 funtov, 1 funt (= 400 g ) = 32 lota, etc. 


4. Sets of real numbers 


We shall discuss various sets of real numbers — for example, the 
set of natural numbers: 1, 2, 3, 4,..., m,.-., the set of all proper 
Fractions, the set of all rational numbers, the set of all real numbers 
between 0 and 1, etc. 

The numbers are called the elements of the set in question. 


One can consider sets of elements of any kind, and not merely sets of real 
numbers. For instance, the set of points of a plane, the set of trees in a district, 
etc. The elements of these sets are respectively points of a plane, trees, etc. 


Sets are denoted in this book by capital letters: M, N, A, B, X, 
Y, etc., or by the symbol {X nbs where x,, are the elements of the set 
(countable sets), The set of numbers satisfying the inequalities 
a<x<b (a, b are numbers) is called an interval and is written as (a, b). 
The sets of numbers satisfying the inequalities x<a, x>b, are called 
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infinite intervals and are written as (— «, a) and (6, + ~) 

respectively. The set of numbers x satisfying the inequalitiesa = x =b 

is called a segment (or closed interval), and is written as [a, 5]. 
The sets of points x satisfying the inequalities 


aex<b, a<x=b, 


are called semi-intervals and are written respectively as [a, 5), (a, 5]. 

The infinite semi-intervals (— oo, a] and [b, + ) are similarly 
defined. 

The interval (x—«e, x+e), (€ = 0) is called an e-neighbourhood of 
the point x. 

If an element x belongs (does not belong) to the set X, this is written 
symbolically as x € X(x€ X or x¢ X). 

Tf all the elements of a set X are simultaneously elements of a set 
Y, X is said to be a subset of the set Y, and we write symbolically: 
X c Y., Otherwise, X is not a subset of Y, and we write this symbol- 
ically as X C Yor X ¢ Y). For example, 


Fe@, b, @€{a, b) @€(@, 5), bela, B): 


(0, 1) c [0, 1), (1, 2] = @, 1), (a, 5) S {, b). 


The set M of all the elements that belong both to a set A and a 
set B is called the intersection or product of the sets A and B, and is 
written symbolically as 


M=AQB (M=AXB= A.B = AB). 
For example, 


©, n=[-7 1|n0, 2), b=, BIN, °) 


and so on. 

The set M consisting of all the elements that belong either to a set 
Aor toa set Bis called the union or sum of sets A and B, and is denoted 
symbolically by 

M = AUB (M = A+B). 
For example, 


0, aul sz to) =O, +2) (-3 NG I= (3, 8, 
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The set M consisting of the elements of a set B that do not belong 
to a set A is called the complement of the set 4 with respect to the set 
B or the difference between the sets 4 and B, and is written symboli- 
cally as 

M=B\A (M = B-A). 
For example, 


(7, 8] = (5, 8I\(—3, 7h, BN [2 z) a E 2) etc. 


The notation B\A is employed in more general cases. 


5. Bounded sets, upper and lower bounds 


A set X of real numbers is said to be bounded from above (below) 
if there exists a number M (m), not less (not greater) than all the 
numbers x € X. The number M (mm) is called an upper (lower) bound 
of the set X. 

A set X is said to be bounded if it is bounded from above and below. 
For example, the set (— >, 0) is bounded from above, the set 
(0, +) bounded from below, while (0, 1) is a bounded set. 

The least (greatest) of all the upper (lower) bounds of a set YX is 
called the strict upper (lower) bound M* (m*) of the set X and is 
written symbolically as 

M* = supx (m* = inf x). 
xEeX xeX 
The numbers M* and m* possess the following properties: 
(1) The inequalities hold for all x € X: 


M*2=x, m*=sx. 


(2) Whatever the number ¢ > 0, a number x, € X can be found 

for which, respectively, 
Xo= M*t—e, xp sSm*+e. 
For example, 
sup x=0, inf x=0. 
x € (0, 0) x € (0, x) 

(3) If the set X = {x} is bounded from above (below), it has a 

strict upper (lower) bound. 
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The concepts introduced below (§ 2, sec. 2) of strict upper and 
lower bounds of a function are particular cases of the strict upper 
and lower bounds of a set. 


6. The theory of irrational numbers 


Precise irrational number theories, due to Dedekind, Cantor and 
Weierstrass, made their appearance in the second half of the nineteenth 
century, in connection with the critical consideration of the funda- 
mental concepts of analysis. 

Dedekind’s theory. 

The set of all rational numbers with all their properties is assumed 
given. The set of all rational numbers is divided into two classes A 
and A’. This division is called a section in the rational number domain 
if the following conditions are satisfied: 


(a) every rational number falls into one and only one of the sets 
A and A’, 

(b) every number a of the set A is less than every number a’ 
of the set 4’. 


The set A’ is called the upper class,and the set A lower, a section 
is denoted by A]/’. 

Sections can be of three types: 

(1) either there is no greatest number in the lower class A, while 
there is a least number r in the upper class 4’; 

(2) or there is a greatest number r in the lower class A, while 
there is no least in the upper class 4’; 

(3) or there is no greatest in the lower class, and no least in the 
upper class. 

We say in the first two: cases that the section is performed by the 
rational number r (which is the boundary between the classes 4 and 
A’), or that the section defines the rational number r. In the third case 
the section A|A’ defines no rational number; we say that a section of 
type (3) defines some irrational number «. 

For example, if all the numbers as 0 are referred to class A, 
as also the numbers a > 0 for which a? < 2, while all the remainder 


are in class A’, the section A| A’ defines the irrational number J2. 
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All real numbers can be ordered in the following way: two irrational 
numbers « and f, defined by the sections 4|.4’ and B|B’ respect- 
ively, are reckoned equal if the sections 4 | A’ and B| B’ are iden- 
tical, and conversely, if the sections 4 | A’ and B|B’ coincide, the 
respective irrational numbers are said to be equal. We say that 
the numbere > fif the class 4 wholly contains the class B, which 
does not coincide with A, anda > 7, where r is any rational number 
of the class A. Hence only one of the following relationships is possible 
for any two real numbers « and Bf :« = p,a#=<f,a>f. 

If sections are performed as described above in the domain of real 
numbers, it turns out that there always exists for any such section 
A|A’ a real number accomplishing the section. This is the essence 
of Dedekind’s basic theorem. This property of the set of all real 
numbers is described by saying that it is complete or continuous. 

We can introduce for real numbers the concepts of the arithmetical 
operations and laws (addition, multiplication, division by a non-zero 
number, etc.). For instance, the sum of two real numbers a and £ 
is taken to be the real number y = « + 8 which satisfies the relationship 
at+tb<y<a'+b’, where a, a’, b and b’ are all possible rational 
numbers satisfying the inequalities: e<a=<a',b<B«<b’. 

All the other arithmetical operations can be similarly introduced, 
while retaining the fundamental properties. 

Cantor’s theory. We take all possible fundamental sequences (see 
§ 3, sec. 2) of rational numbers. A sequence of rational numbers, 
convergent to a rational limit, is fundamental. At the same time, there 
exist fundamental sequences of rational numbers which do not have 
tational limits, as for instance the sequence of decimal approximations 
{l; 1°4; 1:41; ...} of the square root of two. 

Two infinite sequences {x,} and {y,} are said to be equivalent 
or confinal if |x,—y,,| tends to zeroas n + eo. This means that two 
equivalent fundamental sequences {x,} and {y,} can only have 
the same rational limit x as m—> eo. All equivalent fundamental 
sequences of rational numbers are referred to one class — the equi- 
valence class, and the set of all fundamental sequences of rational 
numbers is divided into equivalence classes. 

There are two possibilities: either there exists a rational number 
r, the common limit as n + co of all sequences {x,} of the same 
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equivalence class X, or there is no such number among all the rational 
numbers. 

We say in the first case that the equivalence class X defines the rati- 
onal number r; in the second case, we say that the equivalence class 
X defines an irrational number x (which is also regarded as the limit 
of the sequences of the class X as n+ oo), Every equivalence class 
defines a real (rational or irrational) number. 

Arithmetical operations may also be introduced for all real numbers. 
For example, the sum x+y of two real numbers x and y is taken 
to be the number which is defined by the class ¥+Y, where YX is the 
equivalence class defining the number x, and Y the equivalence class 
defining the number y, the sum X-+Y being understood as the class 
to which sequences of the form {x,+y,} belong, where {x,} is any 
sequence of X, and {y,} any sequence of Y. 

All the other arithmetical operations on real numbers may be simil- 
arly introduced. 

A real number x is said to be positive (x >-0), if the corresponding 
equivalence class X contains a fundamental sequence of positive 
rational numbers not convergent to zero. 

The inequality «>, where «and 8 are two real numbers, means 
that «—f > 0. 

The concepts of fundamental sequence and equivalence class can 
also be defined on the set FE, of all real numbers. It turns out that 
all fundamental sequences are convergent on E, (see § 3, sec. 2), 
so that any equivalence class on E, defines a real number — the 
common limit of sequences convergent to it. No new numbers can 
be obtained with such a completion of the set E,; in this sense, the 
set E, is complete. 

Thus the real number set £, is obtained as a result of completion 
of the set of rational numbers by the limits of all possible fundamental 
sequences-of rational numbers. This idea of completion has acquired 
great value in functional analysis. 

As regards other irrational number theories, we may mention, 
in addition to Weierstrass’s, A.N. Kolmogorov’s argument (see 
ref. 6, p. 269) and the axiomatic construction of the real numbers 
(see ref. 4, p. 157, and ref. 15, p. 180). 
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§ 2. Functions. Sequences 


1, Functions of one variable 


If we are given a set of real numbers X = {x}, and each number 
x € X is associated with a corresponding number y, where Y = {y} 
is the set of all such y, the function y = f(x) is said to be defined 
on the set X. The set X is called the domain of definition of the function 
f(x), and every number x € X the argument. The set Y is called the 
range of the function f(x). If the argument x is given, the value y = f(x) 
of the function is given. For instance, for the function y = x° the sets 
X and Y coincide with the real axis £,; for the function y = tan x 
the set Y is the whole of the real axis E,, while ¥ = E,—M, where 


M is the set of all numbers of the form a+ n(n = 0, +1, +2,...); 


for the function y= x! the sets Yand X are the sets of natural numbers; 
for the function y = E(x) (the integral part of x), XY is the real line 
E,, and Y is the set of natural numbers, For the function 


.-1l for x<0O, 
sign x = 0 for x=0, 
1 for x>0 


the set X is the real line, while the set Y consists of three numbers: 
-1,0, 1. 

Any finite set of numbers {a,} (i = 1, 2, ..., m) can be regarded 
as a function, given on the finite set of natural numbers ¥ < {1, 2, 
...,m} and associating with each of these numbers i the value of the 
function Sf) = a, @ = 1, 2, ..., 7). 

The concept of a function has been subjected to wide generaliza- 
tion. X can be a set of arbitrary elements. A numerical function is 
said to be given on this set if a number f(x) is associated with every 
element x of the set. 

We shall consider in Chapter II functions defined on a set of 
points (or vectors) of n-dimensional space. The area bounded by a 
polygon, or its perimeter, can be regarded as functions defined on 
a set of plane polygons; physical magnitudes, such as the mass of 
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a body, its charge, etc. are defined on the set of corresponding physical 


bodies, etc. 
The elements of a set X, on which a function is defined, are occa- 


sionally called points. 


2. Upper and lower bounds of a function 


An upper (lower) bound of a function f(x), defined on a set X, is 
a number M(m) such that f(x) = M(f(x) = m) for all x € X. If this 
number exists, the function f(x) is said to be bounded from above 
(below) on X. A function, bounded from above and below on X, 


is said to be bounded on X. 

The least (greatest) of all the upper (lower) bounds of a function 
F(x) is called the strict upper (lower) bound M*. (m*) of the function 
and is written as 

M* = sup f(x) ( = inf Fx). 
we x xe xX 
If there exists an element Xo (x,) of X, for which 
f(%o) = sup f(x) ( fa) = inf fix), 
xe x xeX 
then 
sup f(x) = f(%o) ( inf f(x) = fey) 
weX xe xX 


is called the absolute maximum (minimum) of the function f(x) and 
is written as 


S(xo) = sup f(x) = max f(x) (fev = inf f(x) = min He). 
xe x xeExX xeX xeXx 
In this case, we say that f(x) attains its absolute maximum (minimum) 


at the point Xp» (x) 
Given the finite set a,, a,...,a,, we write 


max {a), a, ..-, Gp} =e {d, dg, -.+, an}) 
n n 


for the maximum (minimum) of the numbers a, a, ..., @,- 
For example, 


- 1 Swat é 
inf —=0, minsinx = —1, max sinx= 1, 
€ (0, 00) ¥ xe Ey x€ Ey 


max {4, 3, 7, 11, 8} = 11, min {4, 3, 2, 10, 17}= 2. 


12 MATHEMATICAL ANALYSIS 
The following inequalities hold: 
@) sup f(x)+ sup f(x) = sup (f) +A), (1.3) 
xeX xe Xx xeX 
inf f(x)+ inf fio) = inf (60)4+AC)). (1.4) 
xeX xe xX we X 


If f(x), A(x) and f,(x)+/(%) attain a maximum (minimum) on X, 
then we have 


ana f(x) + ses AC) = max (f0)4+A0d), (1.3a) 
min f(x)+ min f(x) S min (f() 440). (1.4a) 
xe X xeX xe XxX 


The sign of equality holds in (1.3a) (or in (1.4a)) when /{x) and 
A,(x) attain a maximum (minimum) at the same point. 
For example, 


max sin x-+ max cos x = 2 > max (sin x+cos x) = /2. 
xe Ey x€ Ey x€ Ey 


(2) If Yc ¥ (the set Y is part of the set X), we have 
sup f(x) = sup f(x), inf fO) = inf fOo. 
vey xEex yey rex 
For example, 
max sinx = v2. max sinx = 1, 
me [o. | neEy 


max (3, 11, 15, 8) = 15 > max (3, 11, 8) = 11. 
The following notation is often used, 
(f=), Ga)<4, Fossa, S%>9, (Of) = 4) 


and similar ones, to denote the sets of points x for which the respective 
inequalities are satisfied (they are called Lebesgue sets). 


For instance, (x? < 2) is the interval (—./2, J2); (sin x = 1) is 
the set of numbers {en Dpal , where is any integer. 
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3. Even and odd functions 


Let us consider functions defined on the real axis or on the segments 
[—a, a] and intervals (—a, a) (in general on a set M, symmetric with 
respect to the origin). 

A function f(x) is said to be even if f(—x) = f(x) for any x of 
its domain of definition, and odd if f(—x) = —/f(x). All even powers 
x2” are even functions, and all odd x?"+1 are odd functions. Other 
examples of even functions are cos x, |x|, and of odd: sin x, tan x, 
etc. 

A sum of even functions is even, and of odd, odd. The product of 
even functions is even; the product of an even number of odd functions 
is even, and of an odd number, odd. For example, sin x tan x is 
an even function, x sin x tan x is odd. The product (and quotient) 
of an odd and even function is odd. For example, |x| sin x is odd. 

A constant is an even function. 

Any function of an even function is an even function, e.g. e!*!, 
sin (cos x) are even functions, An even function of an odd function 
is an even function, e.g. cos (sin x). An odd function of an odd func- 
tion, is an odd function, e.g. tan (sin x). 

Any function f(x) is expressible as the sum of an even function 
A(x) and an odd function f(x): 


f(x) = AQ)+£O), 


where 


AG) = FLA +M- tC, 


fe) = FUO)-A-a1-¢ 


(C is a constant). 


4. Inverse functions 


Given two sets ¥ and Y, each element x € X being associated with 
some element y = A(x) € Y, a mapping (or correspondence) A of 
the set X into the set Y is said to be given. 
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If y = A(x), y € Yis called the image of the element x € X, while 
x is the pre-image of y. 

If a unique element x € X corresponds as pre-image to each element 
y € Y, the mapping (correspondence) A is called a one-to-one mapping 
of X into Y. 

EXAMPLE 1. Let all the houses of a street be numbered by the 
integers from 1 to 80. We have a one-to-one correspondence 
between the set of houses and the set of the first 80 natural numbers. 

EXAMPLE 2. Let £’ be the set of all non-zero real numbers; one of 
the two signs + or — is associated with each number x € E’. We 
have a mapping of E’ into the set of signs consisting of two elements; 
the pre-images of the sign + (—) are all positive (negative) numbers. 

Let the sets X and Y be sets of the numerical axis E,; the mapping 
A = f(x) of the set X into Y is some function y = f(x), defined on 
the set X, with the domain of values Y. 

If the function y = f(x) is a one-to-one mapping of the set X into 
the set Y, we say that there exists for the function f(x) the inverse 
Junction x = oy), which maps the set Y into the set X. The set Y is 
the domain of definition of the function x = g(y), while the set XY 
is its range. 

1 


EXAMPLE 3. y = sin x, x = arc sin y, X = [-5- 37]. 


EXAMPLE 4 yatan x, x= arctan y, X= [2a 37]. 


EXAMPLE 5. y = e (k #0), x = (I/k)log y, X=. 


5. Periodic functions 


A function f(x) is called periodic if a number m>0 exists such 
that, for any x, 
Ax+o) = fi). (1.5) 
The number @ is called a period of the function f(x). If @, and 
@,» are periods of f(x), @,+@, is also a period of f(x). 
The least of all such positive numbers w is called the least period 
(or simply the period) of the function f(x). 
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THEOREM 1. If a continuous (see § 3, sec. 11) function f(x) is periodic 
and differs from a constant, then it has a least period w, > 0, and all 
its remaining periods are multiples of wo. 

For instance, when f(x) = sin x we have w) = 2x, when f(x) = 
= {sin x| the period@, = 2, and when f(x) = E(x) (see § 2, sec 1) 
the period wy) = 1. 


6. Functional equations 


A functional equation is an equation connecting different values 
of functions; we say that a function, for which such an equation 
holds, is a solution of the functional equation, or, that the functional 
equation is satisfied by it. 

EXAMPLE 6. Solutions of the functional equation 

fxt+y) =f) +f0) (1.6) 
include the linear functions 
ix) =kx — (k is a constant). 


It can be shown that they are the only continuous functions satisfy- 
ing this functional equation. 
EXAMPLE 7. Solutions of the functional equation 


S) -fO)= Ax+y) (1.7) 


include the exponential functions a*(a = 0), these being the only 
continuous functions that satisfy this equation. 
Notice that periodic functions satisfy the functional equation 


Ax+@) = fi). 
We can also discuss systems of functional equations. For instance, 
the pair of functions 
f(@) =sinx, p(y) = cosy 
(and the pair of functions f(x) = 0, y(x) = 0) is the unique con- 
tinuous solution of the system of functional equations 
I&+Y) = f)GOY)+ OP), 
PX+Y) = 9) PO) —SOYO), 
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if we required in addition that the functions be positive in the interval 
(o 37) and that the conditions f ($) =1,9 (3+) =0 be 
satisfied. 


7. Numerical sequences 


A function, defined on the set of positive integers, is called an infinite 
numerical sequence if for each positive integer n(n =1, 2, 3,...) 
there is a corresponding number x, — the n-th term of the sequence 
{xq} = {%1, Xa--+5%Xpy-.-}. The number n in the expression x, 
is called the index (or subscript). We sometimes consider sequences 
{x,} where, in addition to the natural values, » can be zero or have 
any integral value. : 

We shall say that, when m>n, the term x,, follows the term x, 
(x, precedes x,,), independently of the actual magnitude of the numbers 
x, and x,,. A sequence is regarded as given if a relation is known 
for forming the terms of the sequence. It is often possible to find 
an expression (formula) for the general term x,, of a sequence. 

EXAMPLE 8. Arithmetical progression 


X, = at(n— Da. 
EXAMPLE 9. Geometrical progression 
Xn = ag}, 
EXaMPLe 10. Decimal approximations to the numberz= 3-14159...: 
X= 3; xX,= 31; x3 = 3-14; x, = 3-141; .... 
EXAMPLE 11. Let n=a,a....a, be a given number in the decimal 
system, where a, @,...,@, are digits; then the numbers x, = 


=0+a,a,,...4, and y, = O+a,a,_,...a, form numerical sequences 
when 2 = 1, 2, .... For example, when 


n= 15 we have x15 = 0-15; y;; =0-51. 
EXAMPLE 12, We decompose the positive integer 1 into prime 
factors 


n= per, pile... pee, pilesgitl ||| pint 
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and define a sequence {x,} as follows: 
RS ph . pe ede pie » py sieertD hee Prat D 


with n= 1, 2, 3, .... 

For example, 2 = 18 = 21.32, xy, = 3.271 = 3/2. 

It is possible to discuss sequences of vectors, functions, etc., as well 
as numerical sequences. 


8. Upper and lower bounds of a sequence 


A sequence X = {x,} is said to be bounded from above by a number 
M if x,=M for all indices n. In accordance with the definition 
given in § 1, sec. 5, the number M is called an upper bound of the 
sequence {x,}. The sequence X = {x,} is said to be bounded from 
below by the number m, if x, & m for all x. The number m is called 
a lower bound of the sequence {x,,}. The sequence is said to be bounded 
if it is bounded from above and below. 

The least 1/*(greatest m*) of all the upper bounds M (lower bounds 
m) is called the strict upper (lower) bound of the sequence {x,} and 
is denoted, as before, by 


supx, = M* and infx, = m*. 
n n 


The propositions of § 2, sec. 2, hold for the strict upper and lower 
bounds of a sequence {x,}. 


9. Maximum term of a sequence 


Given a sequence {u,} (k = 0, 1, 2,...), we sometimes want to find max u, — 
k 


the maximum term of the sequence {4}, provided such a term exists; let us callit u: 


+ 


& = max u,. 
R 


The subscript of the maximum term of {u,} is called the central subscript and 
is denoted by ». If the terms of {u,} include several that are equal to u, the greatest 
of the subscripts of these terms is taken as ». 

Ifu, = u,(x) are functions of x,x € X c E,, then» = »(x), w = p(x) are also func- 
tions of x. 

EXamPLe 13. Given the sequence {u,(x) = x*/k1} (k = 0,1,2, ...), the number 
v(x) = E(x) =n, while the maximum term u(x)=x"/n! for non-integral x; if x is 
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an integer, x = m, then »(x) = m, while u(x) ~ u»,_, = 4, For example, with 
x = 6 we have »(6) = 6, u(6) = u, = 65/5! = 68/6! 

EXAMPLE 14, Given the sequence {u,(x)=2*/(2k+1)!} (k = 0 1, 2, ...), the 
index of the maximum term is defined by the inequality 


2u(2n+1) = x S (Qn+2) (2n+3), 


and, with fixed x > 0, the maximum term u, corresponds to the value n = E(x). 


10. Monotonic sequences 


A sequence {x,} = {x,, %y,...,X,} is said to be monotonically 
increasing (decreasing), if 


Xy<Xyp<Xy<...<X,<... 
(1.8) 
(%y > Xp > Xe... SH XS .-), 
and to be non-decreasing(non-increasing), if 
XESS XZS~... SHE... 
: (1.9) 
(4 Bx, BE... BXyBz.... 


Sequences of the form (1.8) and (1.9) are described as monotonic, 
sequences of the form (1.8) being monotonic in the strict sense (or 
strictly monotonic). For example, the sequences {x,,}, where 


1 1 
1 > Xn = 5 aaa X, = 2+5(1—1) 


x, = 2— ———- 
ons. 

+3 
are monotonically increasing in the strict sense; the sequences {x,,}, 


where 
1 1 


Ss Xn = 
Tt ff + Th Jrt+l ? 
are monotonically decreasing in the strict sense; the sequence {x,}, 
where 


1 1 
x, = 1; %=5 %= 5 “=> aly 


is non-increasing; the sequence {x,,}, where 
X%,=0, m%=1, x3=2, xm =2, x3=3, x= 4,... 


is non-decreasing. 
All the above-mentioned sequences are monotonic. 
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11. Double sequences 


A double sequence {a,,,} is a function of a pair of integral subscripts 
nand m; to each pair of integers 7 and m there corresponds a number 
@nm — the term of the sequence {a,,,}. 

EXamPLe 15. {a,_ = 1/(n?+m*)}(n, m= 1, 2, ...). 

If the numbers n and m are represented in the decimal system by 


N= ApQp_y ++ Qy } (1.10) 


m= bydao wae by 


(it can be assumed that n and m are represented by the same number 
of digits; this can always be arranged by putting a suitable number 
of zeros in front), we can form a double sequence {N,,,,}, where 


N= Nam = ndpQn-1Op-1 eae aby. (1.1) 


ExampLe 16. If 2 = 103, m = 27 = 027, then Nyog 97 = 100 237. 

Conversely, we can associate with every integer N, represented 
by the right-hand side of (1.11) (ifthe number of digits (2k—1) in N 
is odd we put the digit a,,= 0 in front), a corresponding pair of 
integers n and m in accordance with (1.10). 

We thus obtain a one-to-one correspondence between the set of 
pairs of integers and the set of all non-negative integers. 

EXAmpPLE 17. Given the double sequence {a,,,} (n, m = 0, 1,2,...), 
it can be related thus to an ordinary sequence {by} (N = 0, 1,2,.., 
when N = N,,,, we have Oy = Quam: 

The double sequence {a,,,} is said to be arranged as the ordinary 
sequence {by}. 

See Chapter IIi for the summation of double sequences (double 
series). 


§ 3. Passage to the limit 


1. The limit point of a set 


We call xy a limit point of a set X if there is at least one more 
point of X (different from xg) in any e-neighbourhood of the point 
Xq (€ is any positive number). Alternatively, x, isa limit point of a set 
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X if an infinity of points of X is contained in any e-neighbourhood 
of x). A set may have no (or even infinitely many) limit points, 
which may or may not belong to the set. For instance, the set Y = 
={1/n}, where n = 1, has one limit point 0, which does not belongto 
the set; every point of any interval (a, 6) (as also the points a and 5) 
is a limit point of the interval, 

THEOREM 2 (Bolzano-Weiestrass). Every bounded infinite set X 
of E, has at least one limit point. 

A set M is said to be closed if it contains all its limit points. 
7 -, Paley ~, ee} is a closed set; 
any segment [a, b] is a closed set. 

A set M in E, is described as open or as a domain if any point 
appears.in M along with its e-neighbourhood. 

For example, any interval (a, 8) is an open set; any system of 
intervals is an open set. 

The real axis is an open and a closed set; on the other hand, any 
semi-interval (a, B], [~, 8) is neither an open nor a closed set. 

The complement of an open (closed) set M with respect to E, is a 
closed (open) set. 

For instance, the complement of the open set (— -, 0) U (1, 
+ cc) is the closed set [0, 1]. 


For example, M = { 0, 


2. The limit point and limit of a sequence 


The number x is called a limit point of the sequence X = {x,} 
if any e-neighbourhood of x contains at least one term x,, of X 
different from x (i.e. an infinity of terms of the sequence). 

A bounded infinite sequence X = {x,} has at least one limit point. 

The constant number x, is called a limit of the sequence {x,} if, 
given any number ¢ > 0, however small, there is a subscript N (depend- 
ing only on the choice of £) such that, for all n > N: 


|Xn—Xo| < €& 


We say in this case that {x,} has a finite limit x, and write lim x, = Xp, 
=> oo 
or that {x,} is convergent to x», and write x, Xo. The sequence {x,} 


is said to be convergent in this case. This means geometrically that, 
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given any ¢ > 0, from some subscript N, onwards, all the points x, 
lie in the neighbourhood (x9—&, Xo+¢). In particular, x,, is described 


as an infinitesimal if lim x, = 0. A sequence that has no limit is 
> co 
said to be divergent. 


A sequence {x,}, having the property that, given any « < 0, there 
exists a subscript N such that |x,,—x,|< e for allm>N,n>N, is 
described as fundamental. 

A general criterion for the convergence of a sequence {x,} is: 

THe BoLzANo—CaucHy CRITERION. A necessary and sufficient 
condition for the sequence {x,} to be convergent is that it be funda- 
mental, 

We say that the limit of the sequence {x,} is equal to infinity, 

lim ty = ©, 

R-> co 
if, no matter how large the number K > 0, there exists N such that, 
for all n> WN, 


[Xp] > K. 
If the numbers x,(1 > N) are positive (negative), we write 
Betice Ta (Gass Ano = : 
Some limits: 
i ig eae (b # 0). 


a 
no bnk + bit 16. +b, 8 


ia 2 
3 lim t/a =1 for a>l 
n—>oo 
4 lim n= 1. 
n> oo 
5 lim =e [ef. (6.36). 


6: “Hine 

‘ no Vint i(n+2)...2n 4 
pigs = 

a. tim LEN? +N3 4 1 + 


R—> oo n 
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8. For p> 1 
‘ n n \P n \pP 1 
sn {pile eB) J} 
9. For « > 0. 
G—1_ 9a—1 rl gar — J\yt-1y9-1 
lim | 22-143 4 ast ti 1)"-1n =0. 
N—> oo n 
10. If we write 
Ag aa es and Gy_, = "/aga, .-- Gnas 


we have, with a, = Ci: 


lim V4, =2, lim °/G, = Je. 
N—> 00 n> oo 

11. If the above notation is retained for A, and G,, we have 
with a, = a+kd(k = 0, 1,2, ...),a>0,d>0: 


3. Fundamental theorems concerning limits 


1°. A sequence can have only one limit. 

2°, If a sequence has a finite (infinite) limit, it is bounded (non- 
bounded). 

3°. If a sequence {x,,} has a unique limit point x9, the sequence is 
convergent and Xp is its limit. Conversely, if a sequence (x,,) is Sanereet 
tO Xo, Xo is its unique limit point. 

4°. If x is a limit point of a sequence {a,}, there exists eeu 
{a,,}, convergent to x. Conversely, if y is the limit of some subse- 
quence {a,,}, y is the limit point of the sequence {a,}. 

5°. Similarly, if x is a limit point of a set M of the numerical axis 
E,, M contains a sequence {x,} of numbers different from x that con- 
verges to x. 


6°. On the assumption that lim x, and lim y, exist, we have: 
n> co n—> oo 
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lim (p+ Yn) = lim x, + lim yp, 
n> oa N—> co N-> oo 


lim (X_-¥n) = lim x,. lim yp, 
N—> co n—-> co n> co 


lim Xp 
lim 22 = 222 where lim y, #0 
im 4 = 2=>_ ; 
n> oo Yn lim Yn : n—> co " 
n> oo 


4. Some propositions on limits 


1°. Uf lim a, = a and all the a, > 0 (i = 1, 2,...), then 


N—> oo 

; . tat ...+4 
lim “Jayag...¢,= 4, lim 2427? 
n> eo N-> co n 


2°. If A is the greatest of the numbers 


Gy, Ag, «. 6, An (Qj = 0) 
and 
p>0G=1,2,3,..., 0), 

we have 

lim "“/p.a"+poar+ ... tppam = A, 

™m—> oo 

jim 2a par t+... + Pant 

moe = Pia + peay+ ... + pray 


3°. If, for a sequence {a,}, 


and 


both exist, then 
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4°. If 


Pa 


lim ———~+--__ = 0, 0, 
n-veo Pot Pit +++ +Pn ag 


and, asn + -, S, has a limit equal to s, we have 


lim SoPn tS Pn—1tSePn—2t +++ $5nPo is 
N—> oo PotPitPat --- +Pn 


5. Upper and lower limits of a sequence 


The upper (lower) limit of a sequence {x,} isthe strict upper (lower) 
bound of the set numbers which are limits of the sequence, and is 
written as 

lim x, ( lim *n): 
Noo prays) 


For example, 


im [c-or+4] ani, 


lim [oz] = -1, 


n> co 


while at the same time, 
1 3 
sw —lf'+—j[= +, 
ee | J =| 2 


inf [ms ere 
nel, 2... n 

Every bounded sequence has an upper and a lower limit. 

If a sequence is convergent, its limit coincides with its upper and 
lower limits; if the upper and lower limits are the same, the sequence 
is convergent to their common value. 

Given any sequence that has an upper and a lower limit, we can 
readily form monotonic sequences convergent respectively to the 
upper and lower limits: a monotonically non-increasing {x,,} to 
the lower, and a monotonically non-decreasing {x7} to the upper: 
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xR = Sup (Xp, Xngis Xngar ++ eds 
Xen = inf {x, Xntis Xnta0 ++ a 
lim x, = lim xf, lim x, = lim aq. 
Asp oo n> 20 ‘hopes N—> oo 


If {x,} is a monotonically non-decreasing (non-increasing) sequence 


: * * 
and a= lim x,, then ¥, = %,, Xe, = A(X, = G, Xeq = Xy)- 
roo 


6. Uniformly distributed sequences 


Let the sequence {x,} lie on the segment [a, d]. 
Let N,, («, 8) denote the number of the points x, (k = 1, 2,..., 7) 
which lie in the interval («, 8) < [a, 6]. If the limit 
Na, B) 
n 


=o=Pp-« 


exists, then no matter what the interval («, B) c [a, dj, the sequence 
is said to be uniformly distributed on the segment [a, b]. 

EXAMPLE 18. The sequence {y,} of EXAMPLE 11 (see § 2, sec. 7) 
is uniformly distributed on [0, 1]. 

EXAMPLE 19, The sequence {x,}, where 


X_ = an?—[an"], a>0, O<a<1 (n = 1,2, ...), 


([x] is the integral part of x) is uniformly distributed on [0, 1]. 
EXAMPLE 20, The sequence {x,}, where 


X, = alnn)?—[alnn)?], a@>0,0>1 (a = 1, 2, ...) 


is uniformly distributed on the segment [0, 1]. 

Uniformly distributed sequences have applications in numerical 
integration. Obviously, all interior points of the segment [a, 5] 
are limit points for {x,}, and moreover, 


a= limx, 6= lim x. 


n—> co N—> oo 


Given any function /(x) continuous on [a, 5], and a sequence {x,}‘ 
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uniformly distributed on [a, 5], the following relationship holds: 


Conversely, if this equation is satisfied for all functions continuous 
on fa, 5}, then the sequence {x,} is uniformly distributed, 


7. Recurrent sequences 


A sequence {x,} is said to be given bya recurrence formula if the 
first few terms are given and a formula is known, with the aid of 
which x, is expressible in terms of the preceding terms: 

Xn = I (Xn-1, Xnnor sees Xn—p)>s pE=lt@=1,2,.. 2. 
For instance, x, = 1, x2 = 2, x, = %,»_) = %p,..( = 3, 4, ...)- 

The sequence itself is sometimes described as recurrent. 

The simplest example of a recurrent sequence is an iterative sequ- 
ence {x,}: 

Xn = f%n-2)- 
Iterative, and in general recurrent, sequences are of great value in 
approximation methods — for example, in the method of successive 
approximations and Newton’s method. 

(a) The method of successive approximations for solving the equa- 
tion x = f(x), where f(x) is a continuous function, leads to an iter- 
ative sequence {x,}: 

Xho = f{x,} (k = 0, Ly 2, oe s 
where some arbitrary number is taken as x. Here, if the sequence 
{x,} is convergent to x, x proves to be a solution of the equation: 
x = f(x). 

(b) Newton’s method (or method of tangents) for finding the roots 
of the equation f(x) = 0, where f(x) is a differentiable function, 
also leads to an iterative sequence {x,}: 

Xhiy = Pea Tey (kK =0 1, 2,...), 
where some number is taken as Xp; here, if {x,} is convergent, then 


lim x, = x is the required root, ie. f(x) = 0. 
h-+> co 
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(See above, for a sufficient condition for the convergence of the 
sequence {x,} indicated in method (a).). 


8. The symbols o(«,) and O(,) 


A variable that takes a certain sequence {«,} of values is called a 
variant. For instance, the variable term of any progression is a variant. 
If a, and 8, are given variants, while their ratio «,/8, tends to 


zero aS in — =i lim «,/8, = at we say thata, (8,) is an infinitesimal 
A> oo 


(infinitely large quantity) with respect to B, («,) and we write sym- 
bolically: 

Xm = O(Bn). 
For example, 1/n? = o(1/n), n = o(n*). 

If «,, By are infinitesimals and «, = o(f,), we say that «, (8,) 
is an infinitesimal of higher (lower) order with respect to B, («,), 
or «, (8,) decreases faster (more slowly) than B, («,). If a, 8, are 
infinitely large quantities, and «, = o(f,), we say that «, (6,) 
increases more slowly (faster) than B, (%_)- 

If |a,|= C!}8,|, C>0 (C is a constant), we say that 8, has a rate 
of decrease not faster than x, or that «, has @ rate of increase not 
faster than 8, and we write symbolically: 


%, = O(B,). 
In particular, if lim «,/8, = C #0, then a, = O(,) or 


Ba Ee O(z,). N—> co 


For example, 1 = O(Vn?+1). 
The equation 
& = O(1) 
implies that the sequence {«,} is bounded, i.e. that |x, | = C for all n. 
THEOREM 3. Given an arbitrary sequence {X,} = {xt} of the 
following sequences: 
X, = (xh, ap ng he oo}, 
Keg a fxd, BE, boy Ry a sh 
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there exists a numerical sequence X = {x,} = {Xy, Xe)-- +s Xp ++ +}s 
increasing faster (decreasing faster) than any of the sequences {x7}. 

For example, if X, = {n™} = {n), n?, n8,...,77,...}, the 
sequence Y = {m!} = {1!, 2!,3!,...,m!,...} increases at a faster 


rate than any sequence {X,}: lim n"/m! = 0 for any n. 
M—> co 


9. Limit of a function 


Let the function f(x) be defined on some set X. We say that the 
number A is the limit of f(x) as x ~ X9: 
A= lim f(>), 
x xo 
or that f(x) tends to A as x - Xp, if, given any sequence {x,} € X, 


convergent to x, ( lim x, = Xo), the sequence {f(x,)} is convergent 
n—>eo 
to A. Or, in other words, the number 4 is the limit of the function 


F(x) as x > Xo: 


A= iim f(x) (f(x) + A as x — Xp), 
ex 


X—> xy, X 


if, given any positive number e, there exists 6 > 0 such that | f(x)— 4 |< 
<e for all x € X such that 0 < |x—x,|< 6. For example, 


. sinx _. tanx .. 1—cosx 1 
lim —2-=1, lim——=1, lim ———=-—, 
x>o * xo * eo OX 2 

lim x®Inx =0 for any «> 0, 
x70 


10. Right and left continuity of a function 


We shall consider functions y = f(x), defined on sets X¥ of E; 
X will usually be a set such as 


{a, 5), («, B), [a, b), («, A), (- o, + ©), (- Oy 0), 
[0, + 2), (— , 0), 0, +), 
etc, 
Let f(x) be defined on an interval (xo, a). The number A= f(x, +0) 
is called the limit of the function f(x) from the right at the point x»= Xp, 
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if, given any sequence {x,} of (xo, a), convergent to Xp, f(x,) is con- 
vergent to A. We can similarly define at the point x = xp the limit 
from the left f(xy—0) = B of f(x), defined in an interval (b, x9). 
For example, we have for the function y = E(x) (see § 2, sec. 1) 
and for the integral argument x = n: E(n—0) = n—1, E(n+0) = 1. 
When the argument x, = 0, the limits from the left and right of f(x) 
are written respectively as f(—0) and f(+0). For example, if f(x) = 
= sign x (see § 2, sec. 1), then f(—0) = —1, f(+0) = +1. 

A function f(x), defined at a point x = Xo, is continuous there 
from the right (left) if f(xe+0) [f(xo—0)] exists, equal to f(x»). 


J1. Continuous and discontinuous functions 


If 
SXo— 9) = fixo+0) = f%), (1.12) 


the function f(x) is said to be continuous at the point x = xp. If f(x) 
is not defined in the interval (6, xo) or (%, a), the left- (or right-) 
hand term in (1.12) is ignored. (See also p. 59). If f(x), defined on the 
set X, is continuous at every point x € X, it is said to be continuous 
on the set X. 

For instance, f(x) = ED) is continuous for all x = 0. 

Otherwise, f(x) is described as discontinuous. We say that ({(x) has 
a discontinuity of the first kind or jump at the point x = Xp if f(x»—0) 
and f(x» +0) exist, but (1.12) is not satisfied. In all other cases of a 
discontinuous function, the point x = x, is called a point of discont-- 
inuity of the second kind. For instance, the function 


—1 for |x|<1, 
Ie) ={5; for |x| = 
has a discontinuity of the first kind at the points x, = —1 and 
x= +1. 


Certain commonly encountered functions y = f(x) are equal, 
at a point of discontinuity of the first kind x = xo, to the arithmetic 
mean value 


Sx) a So = 0) tie + 0) 7 
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For example, in the case of f(x) = sign x (see § 2, sec. 1): 


We say that f(x) is uniformly continuous on the set X if, given any 
€ > 0, there exists a 6 = 6{e) > 0 such that, for any pair of points 
x', x" € X for which f(x) has a meaning, |x’—x"| < d implies | f(x) — 
—f(x")| < e. A function f(x), defined and continuous on a bounded 
segment [a, d], is uniformly continuous on this segment (Cantor's 
theorem). 


12. Functional sequences 


An important role is played in analysis by functional sequences 
{7,00} (2 = 1, 2,...), defined on some set X of the numerical 
axis £,. Various definitions can be given of passage to the limit for 
such sequences. It is natural to start from passage to the limit at 
each point, when {f,(x)} becomes a numerical sequence for any 
fixed x € X. If the sequence {/f,,(x)} is convergent as m + e for any 
x € X, its limit depends on the point x € X, i.e. is a function f(x) (a limit 
function), and this is written as 

FX) = $) or lima fal) = f(x) xe X. 


EXAMPLE 21. -F fon 220: 
lim arc tannx = > sign c= 0 for x=0, 

N—> +00 = 
x for x>0. 


This example shows that the limit of continuous functions may be 
a discontinuous function. 

As a result of a double passage to the limit, functions can be 
obtained in the limit that have even more complicated discontinuities, 
for instance, 

lim lim (cos 27m! x)" = x(x), 


™M—> oo N—> oo 
where x(x) is Dirichlet’s function: 
_f i. if x is rational 
1x) = { 0 if x is irrational. 
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Remark. Together with functional sequences, we often encounter 
in analysis sequences of numbers, dependent on functions (functionals) 
For instance, the mean values of functions are defined by the limits 
of such sequences, 


If the function f(x) is integrable on [a, 5] and f,, = f(a+vé,), 


6, = = , then 


Nn» oo 


ba ky ee 1 fe d 
lim = Ye fin = 5g | 00 de 
is the arithmetic mean of f(x) on [a, 5); 


ee 
Jim Vinlin Fa = 000 5, | se de} 


is the geometric mean of f(x) on [a, b], and 


‘ n 1\-1 bo dx \71 
inn (San) = 9 [ 75) 


is the harmonic mean of f(x) on [a, 5]. 
The following also holds: 


THEOREM 4. If functions f(x) and g(x) are continuous and positive 
on [a, 6}, then 


() ‘tim | ” e(2) LAGOI dx = max ft), 


{ ” a(x) L/int? de 
(2) lim *3———_____ =_ max f(x). 
— | a(x) (f(x)I" dx x€ [a,b] 


13. Uniform convergence of functions 


The concept of a uniformly convergent sequence of functions {f,(x)} 
plays an exceptionally important role in analysis. 

DEFINITION. 4 sequence of functions {f,(x)}, defined on a set 
X c &, is said to converge uniformly as n > - to the function f(x), 
also defined on the set X, if, given any positive number , an integer 
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N = N(e) can be found, independent of x € X, such that, for alin > N: 
|flx) —f(x) | < «. (1.13) 

If {f,(x)} is convergent as m ~ oo at every point x € X, but does 
not satisfy the uniformity condition (1.13), we say that {/,(x)} 
converges non-uniformly to f(x) on the set XY. With non-uniform 
convergence, the number N depends not only on the choice of «, 
but also on the number x € X: 

N = Ne, x). 

THEOREM 5. If all the functions f,(x) of a sequence {f,(x)}, uni- 
formly convergent to f(x) on X as n-~ © are continuous, the limit 
Junction f(x) is also continuous on X. 

It follows from this that, if the limit function is discontinuous, 
the convergence as n + - of the sequence {f,(x)}.is non-uniform, 

EXAMPLE 22. The sequence {f,(x)} = {x"} is uniformly convergent 
asn—+ co to f(x) = 0 on any segment [0, g], 0 < ¢ < 1; on the 
segment [0, 1] this sequence converges non-uniformly to the function 


0 for 0sx<1, 
faye ts for x= 1. 


¥ yefOQté 


Fie. 1. 


Caucuy’s Test. A necessary and sufficient condition for a sequence 
of functions f,(x), defined on a set X < E,, to be uniformly convergent 
asn—~ co toa function f(x) is that, givenanye > 0, there exists an N, 
depending only on e, such that |f,(x)—fp(x)| < € for all x €X, 
provided only that n > N and m> N. 


THE ARITHMETICAL LINEAR CONTINUUM 33 


Geometrical interpretation of uniform convergence. Let f(x) (n= 
= 1, 2,...) be continuous in [a, 6], and let the sequence {f,(x)} be 
uniformly convergent as n + eo to the function f(x), continuous in 
[a, 5]. Now, all the curves y = f,(x) fall within an e-neighbourhood 
ofthe curve y = f(x) when 1 > N (see Fig. 1), i.e. they are contained 
in the strip between the curves y = f(x)—e and y = f(x)+<«. 


14. Convergence in the mean 


A functional sequence {f,(x)} is convergent in the mean on the 
segment [a,b] c EF, asn-~ o to the function /(x) if, given any 
€ > O, there is a number N such that, for all n > N, we have 


| ” Laid) —fWR dx < 6 


(it is assumed that this integral exists). 
Use is often made of convergence in the mean in various branches 
of analysis (for instance, in the approximation methods of analysis). 
Convergence, defined by the norm of a space (see Chapter II, §1, 
sec. 2), is a generalization of convergence in the mean. 


15. The symbols o(x) and O(x) 


Given two functions x(t) and y(£), defined on a set X, if their ratio 
x(t)/y(4) tends to zero as t+ a € X (lim x(t)/y(t) = 0), we say that 


ima 
x(t) (y(0)] is an infinitesimal (infinitely large quantity) with respect to 
y(t) [x(2)] and we write symbolically: 


x(t) = o((t)). 


For example, t? = o(sint) as t+ 0, 1% = ofe') as t+ @ for 
any n> 0. 

If x(t) and »(t) are infinitesimals as ¢ + a, and x(t) = o()(#)), 
we say that x(t) ((t)) is an infinitesimal of higher (iower) order 
with respect to y(t) (x(t), or: x(t) (y(t) decreases faster (more slowly) 
than y(¢) (x). 

If x(t), y(t) are infinitely large quantities as f + a, and x()= o(y(1)), 
we say that x(t) (y(t)) increases more slowly (faster) than y (t) (x(t). 
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If | x()| = C| (| (C.is a positive constant), we say that x(t) does 
not decrease at a faster rate than y(t) or that x(z) does not increase 
at a faster rate than y(t), and we write symbolically: 


x(t) = OV). 
For instance, tf = O(tsin(1/t)) and t = O(tan 21) as t + 0, 


1 
é= oles’) and et = O(el#*) as t+ 0. 
In particular, if lim x(1)/p({t) = C ¥ 0 (C is a constant), then 
ta 


x() = OLY) and y(2) = O(x(N). 


THEOREM 6. Whatever the sequence of functions f,(x), defined in 
‘the neighbourhood of a point x = a, there always exists a function 
9(x) € M, decreasing (increasing) faster then any of the f,(x) asx — a. 


16. Monotonic functions 


A function f(x) is described as monotonically non-increasing (non- 
decreasing) on a set X (e.g. on [a, 8)), if, given any points x, x, € X 
such that x, < x,, we have f(x,) = f(x.) (f(xD = /(%2)). A function 
J(x) is said to be monotonically increasing (decreasing) in the strict 
sense (or to be strictly monotonic) if f(x) < f(x.) (f(x) > f%)) 
for any x;, X, € X for which x, < x2. 

Functions monotonically non-increasing, monotonically non- 
decreasing, and strictly monotonic are all described as monotonic. 

When f(x) is monotonic, it always has limits from the left and 
right at a point of discontinuity x = x9; if f(x) is non-increasing, we 
have 


S(%o—0) & So) = f(%q +0); 
if f(x)is non-decreasing, 
S%o— 0) = fx) = fl%o+ 0). 


Let y = f(x) be a monotonically increasing (decreasing) continuous 
function, defined in a segment interval or semi-interval ¥ € E,, and 
mapping X into a segment, interval or semi-interval Yc E£; 
an inverse x = o(y) of f(x) now exists, defined on Y. The function 
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¢(y) is continuous on Y and is monotonically increasing or decreasing 
along with f(x). For example, the function y = x? in the semi-interval 
(0, + oc) has an inverse x = Vy in (0, +), 


17. Convex functions 


A function f(x), defined on a set X (a finite or infinite interval, 
semi-interval, segment) is described as convex if, given any numbers 
X, X_ € X, we have 


1 
(BF*) = pve) —feoas 
f(x) is described as concave if the reverse inequality is satisfied: 
- 1 
1( 33) = pits) fo 


This means geometrically that, if f(x) is convex, no are of the curve 
y = f(x) lies above the chord subtending it, whereas if f(x) is concave, 
no arc of the curve y = f(x) lies below the chord subtending it. 

For example, the functions | x |, x?, e*, x+ |x| are convex, while the 
functions — |x|, vx, —e~*are concave; thefunction y = x*(x > 0) 
is convex « = 1 and a < 0 andconcave for 0 <a < 1, A necessary 
and sufficient condition for a function f(x) to be convex on [a, djis 
that, given any numbers x, x2, x3 satisfying a x, < x, < x3 3 0, 
the following inequality holds: 


x, f(x) 1 

X_ f(%) 1) =0. 

X3 f(xs) 1 

If f(x) is continuous (even only from the right) and f(x) = ; Lfx- 


—A)+f(x+h)], it is convex. 


=x 
If f(x) is monotonic in [a, 6}, | f(€) dé is a convex function. 


a 
It must be borne in mind that the graph of a convex function faces 
downwards, i.e. it is a concave curve in the accepted geometrical 
terminology. 
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Convex functions have the following properties: 

1°. A convex (concave) function f(x) is continuous at every point 
of its domain of definition. 

2°. If f(x) is convex, —f(x) is concave on the set X. 

3°. A convex (concave) function f(x), not equal to a constant on 
the segment [a, b], cannot attain a maximum (minium) inside [a, 5]. 

4°, If f(x) is convex (concave) on [a, 5}, and /(x) is a linear function, 
where (a) = f(a) and (b) = f(b), then either f(x) < I(x) (Ax) < Kx) 
at every point of (a, 8), or f(x) = ((x). 

5°. A linear combination of convex functions with positive coeffi- 
cients is a convex function; in particular, the sum of a finite number 
of convex functions is a convex function. 

6°. If f(u) is a non-decreasing convex function, while u = (x 
is a convex function, f[¢(x)] is a convex function of x. 

7°. The inverse of a decreasing (increasing) convex function is 
a convex (concave) function, 

8°. If f(x) is convex on [a, 5], given any positive numbers p;> 0 
(Gi = 1, 2,..., m) such that pj+p.+...+p, = 1 and any points x,, 
Xe, . ++) X, on the segment [a, 5], we have 


SUX, + DaXet 006 HPaXn) SPS) + Pofl%)+ --- +Prf(%n)- 


9°, Any convex function f(x), satisfying the condition f(x,) = 0, is 
expressible in the form 
ze 
fo) = ) p(t) dt, 
xo 
where p(t) is a non-decreasing function, continuous from the right. 
A function ¢(x), defined on a set X Cc E,, is described as logarithm- 
ically convex if log p(x) is a convex function, i.e. if 


x — x. 


#(AZ*) = movecs 


for any x;, x, € X. Alogarithmically convex function is a convex func- 
tion. For instance, the function g(x) = x log x is logarithmically 
convex for x>0; (x) = e** is logarithmically convex for all x € 
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€(—~, +); o(x) = x* (kis an integer) is logarithmically convex for 
xX €(—oo, +o) and even k #0, for x€ (0, +0) and any & #0; 
F(x) = | 2 -te7'dt is logarithmically convex for x > 0 (concerning 


a 
the function I(x), see Chapter VI, § 4, sec. 5). 


CHAPTER II 


n-DIMENSIONAL SPACES AND 
FUNCTIONS DEFINED THERE 


Introduction 


We considered in Chapter I functions ofa single variable as functions 
of a point of the numerical axis £,. Similarly, functions f(x, y) of two 
variables can be regarded as functions of a point of the plane EZ, with 
coordinates x, y, and functions f(x, y, z) of three variables as functions 
of a point of space £, with coordinates x, y, z. 

About the middle of the last century, coordinate space of n dimen- 
sions was introduced into mathematics, and functions of variables 
came to be regarded as functions of a point of n-dimensional space. 
At the same time, various concepts of ordinary two- and three-dimen- 
sional geometry were generalized to n-dimensional spaces. 

This generalization proved to be not merely formal. Our geometrical 
intuition can be carried over to multi-dimensional entities, and the 
treatment in geometrical terms of the problems of analysis and algebra 
of n dimensions led to greater clarity. Geometrical intuition sometimes 
enables us to discover the facts in n-dimensional geometry, which can 
be interpreted as corresponding facts of analysis and algebra. 

In the present chapter § 1 deals with the theory of n-dimensional 
spaces, and in particular with the theory of orthogonal systems of 
vectors, which is an elementary analogue of the more complicated 
theory of systems of orthogonal functions, discussed in Chapter IV. 

Section 2 is devoted to passage to the limit, continuous functions 
and continuous (in the generalized sense) operators on them in n- 
dimensional space. It is directly related to Chapter IJ, in-which we 
discussed the same topics for the particular case 7 = 1, 

Section 3 gives a treatment of one of the branches ofn-dimensional 
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geometry — the theory of convex n-dimensional bodies, which, apart 
from its geometrical interest, has acquired importance in a number of 
applied mathematical problems. It should be remarked that no great 
simplification is obtained by confining the discussion of convex 
solids to three-dimensional rather than n-dimensional space; and in 
fact, it is precisely the theory of convex bodies in space of a large 
number of dimensions that has acquired practical applications. 


§ 1. n-dimensional spaces 


1. n-dimensional coordinate space 


An element X of an n-dimensional space E,, is defined as a set of 
n numbers x), %,..., X,. It is written as X(x1, Xo, -.., X,) or X = 
== (X1, Xg, .--, X,)- The space £, is the set of such elements. 

Elements of the space EZ, are treated in two ways: on the one hand, 
they are regarded as points with coordinates x, Xz, ..., X,, on the 
other, as vectors with coordinates X,, Xq, .. +5 Xn, (n-dimensional vector 
space). We shall start by using the first treatment. 

There are various ways of introducing distance or a metric into 
the space EZ, (see, for example below, § 3, sec. 3). The most com- 
mon is the following (Euclidean) metric: the distance o(X, Y) between 
the points X(X1, Xe, 0115 X_) and Y (yy, Yo .++s Yn) Of E, is defined as 


the number 
ak Y= | ¥ Gy. (2.1) 
ist 


The space E, with a distance introduced in this way is called n-dimen- 
sional Euclidean space. 

Formula (2.1) reduces to the formula for the distance between two 
points in analytical geometry when n = 1, 2, 3. 

We write @ for the point with zero coordinates: @ = (0,0, ..., 0) 
(the origin of coordinates). We have 


o(X, 6) = | 4. (2.2) 


i=l 
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The distance thus introduced has the following properties: 
(1) 0%) ¥) 20, where o(X, Y) = Oonly when X¥ = Y; 
(2) 0X, Y) = of, ¥); 
(3) AX, Y) = ofX, Y)+0(¥, Z) 


(the triangle inequality). 
An attempt is generally made to preserve these properties in 
generalized concepts of distance. 


2. n-dimensional vector space 


The n-dimensional space E,, can also be regarded as a vector space. 
The operations of addition and multiplication by a scalar (number) 
can be performed on vectors in the plane E, and in three-dimensional 
space E. Every element X (x,, x9, ..., X,) of E,, will be regarded as a 
vector with coordinates x,, Xq, .. +5 Xp 

The sum of two vectors X (Xz, Xa, «++» X,) and Y (Vy, Ya, ~~ +2 Yn) 
is the vector X+Y of E, with coordinates x+y, X2+ Je, +s X_tVy 
The difference X—Y is similarly defined. 

If 4 is a number (scalar), and X(x,, %,, ..., X,) is a vector of E,, 
AX denotes the vector of E, with coordinates Ax, Ax, ..., Ax, 
Vectors X and AX are described as collinear. Linear operations on 
yectors reduce to linear operations on their coordinates. 

The zero point 0 corresponds to the zero vector 6 with components 
equal to zero. Obviously, X+0 = X, 16 = 0. 

The vectors 


e(1, 0, 0, ..., 0), (0, 1, 0, ..., 0), «.., &n(0, 0, ...59, 1) 
or alternatively, 
C(Oi2» Sins ++ +s Oijr e+ +> Oin)s 
where 6,, is the Kronecker delta: 
0 for ij, 
t= { for i= j, 
ds 
are called unit vectors. The following equation holds for any vector 
X = (X4, Xa, 6 oy Xp)? 


n 
= y Xe. 
i=l 
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The norm || X|| of the vector X is the number 


Wx= fy 8 (2.3) 
i=l 


equal to the distance o(X, 9) from the point X to 6. 
The norm of a vector satisfies the conditions: 
(1) {]X]| 20, where || X]| = 0 only when X¥ = 0; 
2) aX = Alix Ts (2.4) 
G) IX+Y¥Il Ss UXI+ 1171 
The distance o(X, Y) between elements X and Y, introduced in 
accordance with (2.1), is the same as the norm of the difference be- 
tween the corresponding vectors 
aX, Y) = || xX—- YI. (2.5) 
The sphere S(Xp, r) in E,, of radius r with centre at Xj is the set of 
points (vectors) X, for which 
O(X, Xo) = |] X-Xll <r. 
If we introduce for sets in E, the notation introduced in Chapter I, 
§ 2, sec. 2, we have 
S(Xo. 7) = (0(X, Xo) < 7). 


3. Scalar product 


In analogy with the two- and three-dimensional case, the scalar 
or inner product of two vectors X(x,, Xq, .. +, X_) and YW, Yo, + + +s Vn) 
of E, is defined by the equation 


n 


XY = (XY) = ¥ xy. (2.6) 
i=t 
The elementary properties of scalar products are: 
(1) XY = YX; 
(2) XX = |{ Xj? = 0. 


Caucuy’s INEQUALITY. Given any two vectors X(X,, Xq, «+, X,) and 
LO'1s Yoo «6 +s Yn) Of En, we have 


[XY] s XIII (2.7) 
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or 
Evol = Dado. an 


Equality holds in formulae (2.7) and (2.7’) if and only if the vectors 
X and Y are collinear (i.e. if X = 6 or if Y = AX, i.e. if all the x; = 0 
ory; = Ax; § = 1, 2,..., 7) 

The angle between two vectors. Let X(xX, Xg, «+5 X,) and Y(y,, 
Vey + + +s Yn) be two vectors of E, different from 6; the angle p between 
them is given by 

xy 
cosg = ——— 2.8 
°= Tein Ce 
In view of (2.7), |cos g| S 1. 

The projection of the vector X on to the vector Y is given in magnitude 

by 


aden : 
ill I] x] cos p. (2.9) 


When || Y||= 1, the projection of vector XY on to Yis equal in magnitude 
to their scalar (inner) product: 


XY = || Xi] cos ¢. (2.10) 


EXAMPLE 1, The magnitude of the projection of the vector X(x,, 
Xo, +++; X,) on tothe unit vector e,(i = 1, 2,..., m) is equal to the 
coordinate x; of the vector X. 


4. A linear system and its basis 


An n-dimensional vector space is a particular case of an n-dimen- 
sional linear system. 

A linear system L is a set of elements to which we can apply the 
operation of addition, i.e. the operation of finding a new element 
cé€Z from two elements a, b€ L, c = a+b, and the operation of 
multiplication by a real number A, i.e. the operation of finding from 
an element a¢Z and a number / an element d= AaéL. These 
operations have the following properties: 
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(1) (@+b)+e = a+(b+0); 
(2) at+b=b+a; 

(3) A(Aya) = (Ada; 

(4) A(at+b) = dat db; 

(5) (+Apja = data; 

() la=a 


The system L possesses a zero element 6, for whicha+@ = a,0.a = 0 
for aéL. ‘ 

Linearly independent elements. Elements x;, Xo, ..., X, Of a linear 
system are said to be linearly dependent if there exists a set of numbers 
Ci, Cay ss +5 Cp, NOt all zero, such that 


CyXy tH CgXgt ... +CyxXy = 49; (2.11) 
if there is no such set of numbers, i.e. if (2.11) is satisfied only with 
QHq=...=coq=0, 


the elements x1, %2, ..., X, are said to be linearly independent. 
EXAMPLE 2. On a plane, the vectors X; (1, 1) and X, (2, 3) are line- 

arly independent, while the vectors X, (1,1) and X, (3, 3) are linearly 

dependent (since 3X,—X3; = 0). In three-dimensional space, the 

vectors Y, (1, 0, 0), Yo (1, 1, 0) and ¥; (1, 1, 1) are linearly independent; 

the vectors Z, (1, 0, 0), Z, (2, 1, 1) and Z, (3, 2, 2) are linearly dependent 

since : 

Z,-2Z,+Z; =0 


A linear system is described as n-dimensional if it contains n line- 
arly independent vectors, and any n+1 elements of it are linearly 
dependent. A linear system is said to be infinite-dimensional if it con- 
tains any number of linearly independent elements. An n-dimensional 
vector space is an n-dimensional linear system. 

The set of solutions of a linear homogeneous differential equation 
forms a linear system. In the case of an ordinary nth-order equation 
this system is n-dimensional; in the case of a partial differential equa- 
tion the system is infinite-dimensional. 

The basis of an n-dimensional linear system L,, is any set (e;, eg, .. . 
e,) of n linearly independent elements. 
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Any element | of the system L,, is linearly (and uniquely) expressible 
in terms of the elements of the basis: 


T= xyeytXpegt ... + Xen} (2.12) 


the elements x,e; (i = 1, 2,..., m) are called the components with re- 
spect to the basis (e;, €,..., €,) while the numbers x, are the coordi- 
nates with respect to this basis. 

EXAMPLE 3. The unit vectors e; form a basis in n-dimensional vector 
space: 


e, = (1, 0,0,..., 0), e&=(0,1,0,..., 0), ... 
wees Cy = (0, 0,..., 0, DD. 


An n-dimensional linear system can be regarded as an n-dimensional 
space, in which the elements of the basis play the part of unit vectors. 


Examples of n-dimensional linear systems. Linear systems of functions, for 
which addition and multiplication by a number are understood in the ordinary 
sense, are aften encountered in analysis. We shall quote some examples. 

(1) The (#+1)-dimensional system of polynomials 


n 


PQ) = Dog 
ke 
of degree not higher than n, The system of powers 
sae ae oat aie a 
can be taken as the basis, as also can any system of polynomials 
Po=i, PX) = x+4,9, 
k-1 
P,(x) = x*-+Gg,% +a «0+, Px) = 8+ Yo yr. 
is 
i n-1 
wee y Pa(x) = x" + ye G,:x', 
imo 


(2) The system of homogeneous polynomials P, (x, Xz, ---, X,) of degree 
kin n variables x,, x2, ...,X,,i-e. sums of terms of the form 


Ona, ast th 


Ayky... &, 


where 


ky the+... +k, =k, 
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The basis of this system consists of all single terms of the form tah ao xta 
of degree & = k,+k,+ ... +h,. The number of such single terms (i.e. the number 
of dimensions of the system) is 

(n+k-1)f 

mean! 


For instance, with n = 3, & = 3, the number of them is equal to 5!/3!2! = 10 
(the single terms are xf, xix, X7Xq, XX, X1XqXqo XAG, XY, X$xXq, Hyg, 22). 


If a system L,, has one basis (¢,, é:, ..., €,), it has an infinite set 
of bases. Let (e), e),..., &,) be another basis; then the elements 
e, of the old basis are expressible in terms of the elements e; of the 
new in accordance with 


e = Ly eyej G@=1,2,..., 7”), 


where the determinant |x,;|/ > #0. An element /is expressible in 
terms of the elements of the new basis in accordance with 


n 

ia 

l= ¥. xe;. 
imi 


The connection between the coordinates x, and x; of an element / 
with respect to bases (e,) and (e;) is given by 
n 
x= YD myx; G@= 1, 2,..., 7). (2.13) 
j=l 
It follows from what has been said that the elements of any m-dimen- 
sional linear system L,, with basis (e,, eg, ..., @,) can be regarded as 
vectors of an m-dimensional space in which the elements e, of the 


basis play the role of unit vectors. We shall confine our attention 
to such spaces in the present chapter. 


5. Linear functions 


A linear function or linear form in E, is a function f(X) = f(%1, X%a.. «5 
X,), satisfying the conditions: 


(1) AX+¥) = f(X)—-AY). (2.14) 
(2) f(AX) = Af(X), where 4 is any number. (2.15) 
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If fle;) = y; for the unit vectors e; (i = 1, 2, ..., ), then 


n n 
SX) = fy, X00 Xn) = Ax a) =P yx. (2.16) 
i=1 im] 
The numbers y, are the coefficients of the linear form f. 
These coefficients can be regarded as the coordinates of the vector 
Y¥ = (yy Yas -+ + Yn) Of Ey; we now have from (2.16): 


IX) = YX. (2.17) 


The linear function {(X) is equal to the scalar product of the fixed 
yextor Y with the variable vector X. We usually say that the function 
SX) is generated by the vector Y. 

The scalar product XY is a bilinear function of X and Y: it is a 
linear function of X if Y is fixed, and a linear function of Y if X is 
fixed. : 

We have the equation 


i} Y|] = max FY, (2.18) 


i.e. the norm of the vector Y generating the linear form YX is equal 
to its maximum value on the unit sphere ||X|| = 1. 
Criteria for linear independence. The Gram determinant for vectors. 
Let 

Xi(%in, Xign ++ Xin) G= 1, 2,...,7” 


be vectors of the space E,. From them we form the following 
determinant: 


Nyy XQ + ee Xn 


A, Key ey SO te (2.19) 


THEOREM 1. A necessary and sufficient condition for vectors X;, 
Xy, ..., X,, of E, to be linearly independent is that 


A(X, Xg, ..., Xp) # 0. 


Gram’s determinant Ty, xy, ..., x, of the vectors Xj, X2 ..., Xm 
of £, is given by 
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(XX) (4%) --- (Xm) 
(X_X) (XaX2) --- (XaXm) 


(XX) (XnXo) --» AmXm) 


Gram’s determinant has the properties: 


) Ux. xe... Xe EO 
(2) A necessary and sufficient condition for linear independence 
of the vectors X,, Xg, ..., Xj, is that 


PxiX_... Xn > 95 (2.21) 


Pxix2... Xm = (2.20) 


(3) When m =n, 
Ixix, exe Ae {4(m%, Xy ees XP. 


See Chapter IV, §2, sec. 3 for the Gram determinant for functions. 

Manifolds. Let X,, X;, ..., X, be linearly independent elements 
of £, sk <n). 

A set of elements X of the form 


k 
x= XY CUXy (2.22) 
ist 
with arbitrary real c, is called a k-dimensional linear manifold. 

A one-dimensional linear manifold, i.e. a set of elements of the 
form X = Ax, (x, # 4) is a straight line passing through 6 and x,. 
Part of this straight line — the set of elements of the form X¥ = Ax, 
A> 0, — is called a ray, 

A displaced k-dimensional manifold or k-dimensional plane is a 
set of elements X of the form 


k 
X= Xt ¥ aX; (2.23) 
i<t 
with fixed and linearly independent X,, 2, .... X;, and arbitrary 
values of the numbers ¢,, cg, ..., ¢,- It is obtained by displacement 
of the manifold (2.22) along the vector Xj. A one-dimensional displaced 
manifold is a straight line: 

X= Xot tx (-2< fe + co), (2.24) 

We have for a straight line through the points X, and X,: 
X= (1-O)X,4+ 4X, (— 02 <f< + ~), (2.25) 


48 MATHEMATICAL ANALYSIS 


The segment of the straight line joining points X, and X, is the set 
of elements of the form 


X¥=(-0)¥,4%, Osts). (2.26) 


An (n—1)-dimensional displaced manifold is called a Ayperplane. 
Any hyperplane is given by an equation (i.e. is a set of points X(x%4, 
Xgy »+ ++, Xp), Satisfying the equation) 


n 
YY = ry IjX = d, > (2.27) 
jul 
where YX is a linear form generated by the non-zero vector Y (), ye 
.++y Py): Conversely, every such equation defines a hyperplane. 
In general, any k-dimensional linearly displaced manifold (1 = k < n) 
is given by a system of equations 


n 2 
YX = by Jip = d; (i = 1, 2, wees n—k), (2.28) 
jel 


where the vectors Y; (4; Vig, «++» Yin) G = 1, 2, ...,n—k), generating 
corresponding linear forms, are linearly independent; in other words, 
every such manifold is given by n—k linear equations. Conversely, 
n—k equations (2.28) (with linear independence of the vectors Y;) 
define a displaced k-dimensional manifold. lf all the right-hand 
sides d,=0, we get a k-dimensional (non-displaced) manifold. 
In particular, the straight line (2.24) is given by n—1 equations (2.28). 


6. Linear envelope 


The linear envelope of a set M of E,, is the least linear manifold 
containing M: in other words, the linear envelope of the set M is 
the set of all linear combinations of any finite number of elements 
of M, i.e. of elements of the form 


kg 
¥ ux, Xe M. 
im 


In particular, if X,, X2, ..., X, are linearly independent elements of 
E,, their linear envelope is the k-dimensional linear manifold con- 
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sisting of all elements of the form 


k 
i=1 
Notice that, if the vectors X,, X2, ..., X, form a basis of the 
k-dimensional linear manifold £, of £,, we can supplement them by 
vectors Z,, Z,,...,Z,_, in such a way that the vectors X,, Xq...., Xz» 
Zi, Za, ---, Zp, form a basis in E,. Let E,_, denote the linear 
envelope of vectors L,. Every element Y of E,, can be expressed (unique- 
ly) as 
Y=X+Z, (2.29) 
where 
k n-k 
X= ¥ Xi € Ey Z=> d;Z; € En»: 
i=t j= 
Here, the space £, is the direct sum of the manifolds E, and £,_,, 
this being written symbolically as 


En = ExtEn-w (2.30) 


X and Z in (2.29) are called the components of the vector Y in E, 
and E,_,- : 


7. Orthogonal systems of vectors 


Two (non-zero) vectors X and Y are said to be orthogonal if XY = 0 
(Le. if cos y = 0). The vectors X;, X), ..., X,, form an orthogonal 
system if they are orthogonal in pairs, i.e. 

XX;=0 for ij. (2.31) 

The vectors of an orthogonal system are linearly independent. If, in 
addition, || X;|] = 1, the vectors are said to form an orthonormal 
system. In this case, 

0 for ij, 
X,X; = 6i3 = 2.32 
ae = sy ve i=j. or 

The unit vectors e,, e:, ..., &, form an orthonormal system. 

In 2-dimensional space £,, there exists an infinite set of orthogonal, 
and in particular orthonormal, systems of m elements, but there are 
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no orthogonal systems of (m-+1) elements. A system of n orthogonal 
vectors in E,, forms a basis in E,, called an orthogonal basis. 

THEOREM 2. If vectors €}, €, ...,€, form an orthonormal system in 
E,, any vector X of E,, is expressible (uniquely) in the form 


n 
X= Pi xe, x; = Xe, (2.33) 
iol 
n 
IX1F = P x? (2.34) 
ia] 


The passage from unit vectors ¢,, @, ..., &, in E, to another 
* ’ , tos . 
orthonormal basis €,, €, ..., @, in E, is called an orthogonal trans- 
formation. An inner product of vectors is unchanged in an orthogonal 
transformation, i.e. if 


k ae n La 
X=Vxua= yd Me, Y= p> vier =F) Vee. 
=1 


il wl int 


then 


n n 
XY = FV xy = Ye 
int i=. 

In particular, the norms || X{| = XX (see (2.34)) of all elements 
of E,, and the distance between any pair of such elements: o(X, Y) = 
= ||X—Y/j{, are unchanged by an orthogonal transformation. 

In general, if vectors e;, ¢,, ..., €, form an orthogonal system, 
we have 


oy Pete Sag Xe; 4 
X= Vie, X= Weir (2.33’) 
n n 
XI = » x? Ife; IP = x (Xe;)*. (2.34’) 


In analogy with the theory of orthogonal series (see Chapter IV), 
the coefficients x; in equations (2.33) and (2.33’) can be termed 
Fourier coefficients. 
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8. Biorthogonal systems of vectors 


Two vector systems X;, Xz, ..., X, and Yj, ¥:, ..., Y, of E, 
form a biorthogonal system if 


XiY¥;=0 for i#j, XY¥,;4+0 for i=j. (2.35) 
Muitiplying the vectors X, or Y, by constants, we can arrange that 
X{Y; = 1 (= 1) Ze saison) 


where the old notation is retained for the new vectors. In this case, 
every vector Z of Z,, can be written as 


n 
Ze) py RH, (2.36) 
iml 
or as 
n 
Z= om WX yi = ZY; (2.36’) 


Given a system of n independent vectors X,, Xj, ..., X,;, in E,, we 
can form a system of vectors Y,, Yz, ..., Y,, such that the two systems 
{Xj} and {Y¥;} are biorthogonal. If 


Xi = Oa Mize +s Xin) and Vy = (any Vian +++) Yin) 


formation of the system {Y,} from the system {X;} amounts to 
formation of the inverse ||y,;||};* of the matrix ||x,|[h}. (See 
Chapter IV regarding orthogonat and biorthogonal systems of 
functions). 


i 
EXAMPLE 4. Let X,= )° e i= 1, 2,..., n), where e; are unit 
j=1 
vectors in £,; Y; = e;—e,,, @= 1,2, ...,n—-l), Y, = ey. In this 
case {X,} and {Yj} are biorthogonal systems in E,,. 


9. The projection of a vector on to a manifold 


Let E, be a k-dimensional manifold in n-dimensional space E,, 
(i s k < n). The vector X of E,, is said to be orthogonal to E,, (written 
as X 1 E,) if X is orthogonal to any vector Y of £,, i.e. 


XY=0 if. YL Ee. 
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A vector X, of E, is called the projection of the vector X on to Ey 
if X¥—X, is orthogonal to E£,, 


Xo = Pin, X. (2.37) 
We have: 
X= Xot+(X—X), (X-X) LE, XE 
when X€E,, to pin, X¥ = X. 


If X€£,, Pl-n, X= XX. 
Any vector X of E, has a unique projection on to E,. 
If X, is the projection of the vector X on to E,, we have 


GQ) WXIP = | XolP + 1X Xl, (2.38) 
(2) |X-YIP z l|X—Xoll, (2.39) 


* where Y is any vector of E,, and equality holds only when Y = Xp. 
In other words, the minimum of || X—Yj|?, where Y is any vector 
of E,, is attained when 


Y= X= preg, X. 


Let Uy # @ bea vector of E,. We shall write £, for the set of vectors 
of the form (U, (- ~< t<+ -), ie. the straight line E, = 1U5. 
The projection of the vector X on to the vector U, is defined as the 
projection of Y on to the straight line £,, i.e. we have: 


(XT) Up 


eal oe” 


Ply, X= 


and in particular, if || Ug|| = 1, then 
Ply X = (XU,)U, = (|X| cos g)Up, 


where ¢ is the angle between the vectors X and Up. 

Expansion (2.33) of a vector X into a system of orthogonal vectors 
eC = 1, 2, ..., ™) implies the representation of X as the sum of 
its projections on to the ej, 

Let X,, X2, ..., X);, be orthonormal vectors in E, (k < n); they 
form an orthogonal basis in EZ, — their linear envelope. We can 
supplement them by the vectors Xj, + G=1, 2, ..., n—k) such 
that the n vectors X, (i = 1, 2, ..., m) form an orthogonal basis 
in E,. 
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Let XY be any vector in E,; then 
k 
Prep, x= x Xi, Cha XX. 
iz 


The sum of the first k terms in expansion (2.33) or (2.33’) is the 
projection of the vector X on to the linear envelope of the first k vectors 
X,@= 1,2, ..., 7). 

Let the vectors {X;} (i= 1, 2, ..., k< n) be orthogonal. Let 
k 2 


n 
us form all possible sums 5° c,e;. The expression | X—¥ c;}] attains 


tmi ix 

a minimum when ¢; = x;, where c, is the “Fourier coefficient” ; 
¢; = XX; for || X;|| = 1, while in the general case c, = XX;/I| X;|I, 

Tueorem 3. Let {L,} (i= 1, 2, ..., k) form a basis (generally 
speaking, not orthogonal in E,,), and X be any vector of E,,; then 


k 
Prep, X = y ajL;, (2.41) 
iz 
where d; are given by the system of linear equations 
k 
x (LLj)d; = XL; ° (is by 2h gk), (2.42) 
j=1 


the determinant of which is the same as the Gram determinant I’. 
When k =n, the system (2.42) becomes a system for determining 
the components of the vector X with respect to the basis {L;} (i = 1, 
25.62, 7). 


§ 2. Passage to the limit, continuous functions and operators 


1. Passage to the limit in »-dimensional space 


Let L,, be a linear system with a chosen basis, Every element X € L, 
is defined by its coordinates x1, X_, ..., Xp, X = (x1, Xa...) Xp) 
Let {X,} = {X1, X, ...} be a sequence of elements of L,, where 
Xn = Xmyp Xmgs «+ +> Xmn)- The element X = (x, x, ..., X,) of L, 
is said to be the limit of the sequence {X,,} if 

x, = lim xy (2.43) 


m—-> co 
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(i.e. if all the coordinates of X are the limits of the corresponding 
coordinates of the terms of the sequence {X,,,}). We write convention- 


ally in this case 
X= lim Xp (2.44) 


™M—> co 
and also speak of the sequence {X,,} converging to X. 

The coordinates of the elements {X,,} and X depend on the choice 
of basis in L,, but equation (2.43), i.e. (2.44) also, does not depend 
on the choice of basis in L,: if the coordinates of X,, tend to the 
corresponding coordinates of X in one basis asm — oo, this property 
will hoid for any choice of basis. 

An n-dimensional linear system, in which passage to the limit is de- 
fined in the sense indicated, is called an n-dimensional linear space. 

In Euclidean, and more generally, in normed (see § 3, sec. 3) spaces, 
where the distance between two points, or the norm of a vector, 
is defined, passage to the limit (2.44) can be defined as follows: 
X= lim ¥, if 


M—> co 
lim o(X%,. X)= lim ||%,—XI| = 0. (2.45) 
M— oo m—> co 


Condition (2.45) is equivalent to condition (2.43). Thus, if we define 
the distance between two points or the norm of a vector (§ 1, sec. 1 
or 7) in a linear space, and make use of the definition of limit in 
accordance with (2.45), no changes whatever are introduced into 
the meaning of passage to the limit in L,.t 

There will be no loss of generality if we consider in this chapter 
passage to the limit in Euclidean spaces E,. 

As in the one-dimensional case (see Chapter I, § 3, sec. 2), we 
shall call a sequence {X,,} of E, fundamental if, given any e>0, 
here exists N such that 

i Xm — Xn || <6 
for all m’> N, m> N. 

A necessary and sufficient condition for a sequence {Xj} to have 
a limit is that it be fundamental. 

The concept of limit point (point of condensation) for a set M < E, 
is an immediate generalization of this concept for E, : ¥ is called a 


t This introduction of a distance is called metrization of Ly. 
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limit point of the set M c E, if it is the limit of some sequence {X,,,} 
of points of M different from X. 

An equivalent definition is: XY is called a limit point of the set 
Mifany sphere S(X, ¢) with centre at X contains a point of M 
different from X. 

An analogue of the Bolzano-Weierstrass Theorem holds (see Chap- 
ter I, § 3, sec. 1). 

Every bounded infinite set in E,, has at least one limit point. 

An open set in E, is a set U of points of Z, such that, if a point 
X belongs to U, there exists a sphere with centre at X contained in 
U. An open set is called a domain if any two points of it can be joined 
by a step-line, contained wholly in this set. 

Examples of a domain are as follows: on a straight line, a finite 
or infinite interval; on a plane, the interior of a circle, triangle, strip 
between two parallel straight lines, etc.; in three-dimensional space, 
the interior of a sphere, parallelepiped, cone, etc. 

An example of a domain in E, is a parallelepiped (a parallelepiped 
in £, is an interval), i.e. a set of points X(x, Xa, ...,X,), the coordinates 
of which satisfy the inequalities a,< x,< 6, (= 1, 2, ..., n), 
where a, and b, are given numbers. 

The intersection of any finite number of domains is a domain. 

A boundary point of a domain Q in E, is a limit point of Q that 
does not belongto Q. The set of boundary points of Q is called the 
boundary of Q. A domain Q together with its boundary forms a 
closed domain (or body) in E,. 

For example, the boundary of an interval (a, 5) consists of the 
points a and 5, while the segment [a, 6] is a closed domain; the 
boundary of a sphere S(X9, r) is the surface of the sphere, i.e. the 
set of points Y for which 


aX, Xe) =f Gamay? =v. 
i=l 


A closed set in E,, is a set in E, containing all its limit points; for 
instance, closed domains are closed sets. 

THEOREM 4. The complement in E,, of an open set (domain) is a 
closed set, and of a closed set an open set. 
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For example, the complement of the sphere ({|X|| <r) is the 
closed set (|| X|| = r), the complement of the closed sphere (|| X || = r) 
is the domain (|] X||> 7). 


2. Series of vectors 


The laws for passage to the limits of vectors (points) of n-dimensional 
space £,, are essentially the same as the laws of passage to the limit 
in E,; the generalization to the n-dimensional case of the theory of 
conditionally convergent series (i.e. series which are themselves 
convergent, while the series formed from the absolute values of their 
terms are divergent) is of some importance. 

A vectot series in E,: 


= X= Xt X4+Xt... (2.46) 
= 


is defined like a numerical series. 
If X, = (py Xpgr «+ +> Xgn)s Series (2.46) corresponds to the k 
numerical series 


eo 


»? Xai = MyjtXa txt -.- G@=1,2,..., 7”), (2.47) 
=1 


the terms of which are the coordinates of vectors X,, i.e. of the terms 
of series (2.46), 
The partial sum S,, of series (2.46) is the sum of its first m terms: 


™m 
Sm = p» X= M4tXot+ 2... +X 
=] 


Series (2.46) is said to be convergent if its partial sums S,, are con- 
vergent aS m — oo to some vector S, the sum of (2.46): 


S=> X%, = lim Sp 


hel M—> oo 


The convergence of series (2.46) is equivalent to the convergence 
of all the numerical series (2.47). If S = (s,, 5, ..., S,), then 


5s = D XR (i= 1, 2, 3, ..., m). 
kel 


N-DIMENSIONAL SPACES AND FUNCTIONS DEFINED THERE 57 


Series (2.46) is described as absolutely convergent if the series of 
the norms of its terms is convergent: 


yt Xell 
REL 


The absolute convergence of series (2.46) is equivalent to the 
absolute convergence of the numerical series (2.47). 

Series (2.46) is said to be conditionally convergent if it is convergent 
non-absolutely. We have Steinitz’s Theorem, which is a generalization 
of Riemann’s Theorem (see Chapter III, § 1, sec. 2). 

(1) Jf series (2.46) is absolutely convergent, its sum remains unaltered 
whenever the order of the terms is changed. 

(2) If series (2.46) is conditionally convergent, its sum can be altered 
or it can be made divergent by changing the order of the terms. 

(3) The sums of the series obtained by interchanging the terms of 
aconvergent series (2.46) entirely fill some k-dimensional plane, 0 3 
sk sn (see § 1, sec. 5). 

For an absolutely convergent series, k = 0; for a conditionally 
convergent series, k > 0. 

EXAMPLE 5, Let x, = (—1)*(1/k), and let s be an integer, 1 = s Sn. 
Every positive integer m can be written in the form m = rs+k, 
where r is an integer, l= k Ss, Let XY, = X,,,, = X,€,, where 
é, (k = 1, 2, ..., 5) are unit vectors. 

By changing the order in the series }’ X,,, we can now obtain as 


mh 
the sum, any vector of an s-dimensional manifold E,— the linear 
envelope of the unit vectors e), é, ..., €, (see § 1, sec. 6). 


3. Continuous functions of 7 variables 


Functions of a point (vector) of n-dimensional space. Functions 
of m variables may naturally be treated as functions of a point (or 
vector) of n-dimensional space. Let each point X (x,, X2, ..-, X,) 
of a set M in n-dimensional space E,, be associated with a number 
F(X) = f(y, x2, ..., x,); we mow say that a function f(X) =f(m, 
Xg3- +3 %y) of a point (vector) X or a function of n variables — the coor- 
dinates of this point (vector) — is defined on the set M in E,,. 
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The concept of passage to the limit is introduced for functions 
in E,, as for functions of one variable. 

Let f(X) be a function defined on a set M CE, and let A be a limit 
point of M. We say that f(X) tends to a number a when X € M 
tends to A, if 


lim f(X,) = a. (2.48) 


for any sequence {X,,} of M, convergent to A. 
This is written as 


a= lim F(X). (2.49) 
X— A(X € M) 


if M is a domain and A an interior point, it has to be mentioned 
that X,, tends to 4 while remaining in 4.) 

There is another definition of such a limit, equivalent to the above: 
(2.49) means that, given any e> 0, there is a corresponding > 0 
such that, when 

O<||X-—Al|l<n and XEM 
we have 
\f(%)—a| < «. (2.50) 


Continuous functions. We take a function f(X) = f(x, X, ..., Xp) 
defined on a set Mc E,, and a point X (x, Xa, ..., X,) of this set. 
We say that f(X) is continuous at the point X ¢ Mif 

lim f(X,) =f). (2.51) 
im € Mf 


m—> co, Xpe 


This definition is equivalent to the following: a function f(X) is 
continuous at a point X of a set M if, given any e> 0, there exists 
n = (€) such that, for all points X¥ € M lying in the sphere 

o(X, X) = ||X¥-X|| <n, (2.52) 
we have 


| f(4)-f%)] < «. (2.52’) 


A function that is continuous at every point of a set M is said to 
be continuous in M. 
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EXAMPLE 6, The function 


1 = 1 

i-ixe | 2 . 

Vi-171 pink 2 
iL 


is defined and continuous at every point of the sphere || X||? < 1. 
A linear function f(X) (see § 1, sec. 5) can be defined as a function 
continuous in EZ, and satisfying the additive condition: 


Kit Xa) = AY +N). 


Uniform continuity. A function f(X) = fy, x2, ..., X,), defined 
ona set Mc E,, is uniformly continuous there if, given any ¢ > 0, 
there exists 7 > 0 such that, for any pair of points X,, %,¢ M for 
which 

OX, X) = [1X1 — Xe ll < 9, (2.53) 
we have 


| f(D) -fCQ)| < «. (2.53’) 


The number 7 in (2.52) depends on ¢ and on the choice of the point 
X, whereas in (2.53), defining the uniform continuity of a function, 
it depends only on e« and not on the choice of the points X, 
and X3. 

Every function, uniformly continuous on M, is continuous on M. 
The converse is not generally true (for example, the function 
ty V1=|X12, continuous inside the sphere |[X|| < 1, is uniformly 
continuous there). 

As in the one-dimensional case (see Chapter I, § 3, sec. 11), we 
have 

THEOREM 5. A function f(X) = f(x, X2, ..., Xp), continuous on a 
bounded closed set U, is uniformly continuous there. 

Maximum and minimum. A function f(X), defined on a set MM, is 
said to be bounded from above (below) on M if there exists a constant 
C such that, for any point Y¢ M, 


fMscC (KX)=C). (2.54) 


A function is bounded in M if it is bounded from above and below 
on M. 
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If f(x) is bounded from above (below) on M, a number C(c) exists 
which is the strict upper (lower) bound of the numbers /(X), i.e. of 
the values of the function /(X) at the points M: 


C = sup f(x) ( = inf AX) : (2.55) 
X€M X€M 
If there exists in Mf a point X, at which 
AX) = C = sup f(x), 
X€M 
the upper bound C is called the maximum of f(X) on M: 
C = f(Xo) = ae f(x). (2.56) 


eM 


X, is called the maximum point for f(X) on M. 
Similarly, if there exists in M a point X, at which 


KX) Be, 
c= inf f(x), 
XEM 


twhere 


the lower bound c is called the minimum of f(X) on M, while Xj is 
the minimum point for f(X) on M: 


c= fl) = min fx), (2.57) 
XEM 


We say in this case that f(X) attains its maximum (minimum) on 
M at the point X, (%). 

THEOREM 6, A function continuous on a closed bounded set attains 
its maximum and minimum in the set. 

Jump functions. We often encounter in problems of mathematical 
physics the following generalization of the concept of jump to a 
function of n variables. Let Q, be a domain in E,. We say that it 
is “inside” its boundary I’, while the domain Q,= £,—(Qi+T) is 
“outside” the boundary I’. We shall write A, and A, for the points 
of Q, and Q, respectively. Let a function f (which may or may not 


+ i and e are the first letters of “interior” and “exterior”. 
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be defined on I’) be given in Q,+Q,. Suppose that the limit of /(4,) 
[f(A))] exists, when A, (A,) tends to the point 4 of the boundary I’; 
we shall write here: 


Je(A) = lim f(A,). 
If f(A) # f,(A), we say that the function has a jump 


SA) —filA) 


on passing through the boundary I at the point A from Q, to Q,. 

EXAMPLE 7. Let us take a bounded closed convex domain Q, in 
£, with a boundary J’ (a smooth curve), and the domain Q, = F,— 
-—Q;-I’. Given an arbitrary point 4¢E, we define a number 
«(A) > 0, measuring the angle under which the curve J’is seen from A. 
(It is formed by the rays joining A to all the points of I). 

For points 4,;€Q;, we have a(A,) = 27; for points 4, € Q,, we 
have 0 < a(A,) < 2, where a(A,) — wif A, tends to a point 4 ¢€ I. 
We have (A) = x for points A of the boundary I. 

For the function f(A) = a(A) at the point 4 ¢ I’, we have f,(A) = 
=f) =m « f(A) = 2x; the jump f,(A)—f(A) = —2. 

Functions depending on a parameter. Every function (x, X9) ++ sm} 
ti, tg, ..., ¢,) can be regarded as a family 


{fate nen, ta(Xt9 Xe; see Xn) = OX, Xo, Sey Xm3 hy to, vey th)} 


of functions of m variables x, x,, ..., X,, each of which is defined 
by a set of m values of another group of variables t;, t2,..., t, — called 
“parameters”. We shall confine ourselves to the case of a system 
{ f(x) = ¢(x, t)} of functions of one variable x, depending on one 
parameter ¢; f takes any value froma set 7 of the numerical axis Ey, 
while every function f(x) is defined for x of the set X € £, (the 
general case of n parameters and m variables is investigated similarly). 
Let ¢ be a limit-point of T. If, given any ¢ and x €_X, the function 
Six) tends to f(x) as t + ty (¢ € T), we say that the functions f(x) are 
convergent on the set X to the function f(x). Given any x € X and 
any number n> 0, we can find a number e, depending on 7 and 
x, € = a(n, x), such that 


\fiC)~f@)| <9 (2.58) 
for 0< |t—t)| <e(t € T). 
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For example, let T be the interval (0, ), and X¥ = [0, 1}; the 
family of functions {/,(x)} is convergent to f(x) on [0, I]as¢— Oif 


sin tx 


@) f@=——, fadaxs 
(b) Sil) = a + rxylt, {@ = e: 
©) fd =x", f= | 0 for O<x<1, 


1 for x=1. 


The convergence of { f,(x)} to f(x) on X is said to be uniform as 
i+ t (t € T) if, given any 4 > 0, there exists « = e(n), depending 
on 7, such that (2.58) is satisfied for all x € X when |t—t,| < e (eno 
longer depends on the choice of x). In examples (a), (b), we have the 
case of uniform convergence, and of non-uniform in example (c). 

The following are properties of the uniform convergence of a 
family of functions {f(x}: 

1°. If the family {f(x)} is uniformly convergent on X to f(x) as 
t+ t (t € T), and {t,} is any sequence of T, convergent to to, the 
sequence of functions { f,09} is uniformly convergent to f(x). 

2°. If all the functions f(x) are continuous on X, their uniform 
limit is a function f(x) continuous on X. (See examples (a), (b). In 
example (c), the limit function is discontinuous, which points to the 
non-uniform convergence of {f{x)} to f(x).) 

3°. Let w(x, t) be a function of two variables continuous in the rectangle 
a2x8a4,bs1tsb,. On writing f(x) = p(x, t) for t € [b, d), 
(x) = (x, b;), we find that the functions f(x) are uniformly convergent 
to f(x) ast — by. 


4. Periodic functions of 1 variables. Manifolds of constancy 


Let E, (1 = k S n) bea linear manifold in £,, and /(X) a function 
defined in E,. We say that E, is a manifold of constancy for the func- 
tion f(X) if, given any X¥ ¢ £, and any Y of E,, we have 


AX+Y) = fH. (2.59) 


For example, in the case of the function (x+y) of two variables 
x and y, the straight line x = ~ y is a manifold of constancy. For, 
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if we add to the vector (x, y) any vector (x9, —Xq) of this straight 
line, the function is unchanged. 
Let us bring in the basis in £,, of elements Y,, Yo, ..., 4; Zi, Zz, ... 
-+> Zany Where Yj, Yj, ..., Y, form a basis in the manifold of 
constancy E,. Every element ¥ € E, can be written in the form 
(see (2.29)) 


oe aa 
nok 

Yek, Z= ¥ 2Z, 
i=1 


where 
KX) = f+ 2) = f(2. 

The function /(X) = f(Z) reduces to a function of n—k variables — the 

coordinates Z,, Z,, ..., Z,_, of the vector Z. 

A period of a function of n variables. A period of a function /(X), 
defined on £,, is vector w (different from the zero 0) such that, for 
any X, 

(X+o) = f(X). (2.60) 


It follows from (2.60) that all the elements Y 4 8 of a manifold 
of constancy of a function f are periods of f. A function /(X), having 
a period that does not belong to the manifold of constancy, is described 
as periodic. 

We shall confine ourselves to periodic functions that have no mani- 
folds on constancy. Notice that every periodic function has an infinite 
set of periods (in addition to w, every vector of the form kw, where 
k is any integer, is a period). 

THEOREM 7. If @ and w, are periods of a function f(X), their sum 
@+,, is also a period. 

If 1, 2, ..., Om are periods of f(X), any vector w of the form 


m 
o= ¥ nw, 
isa 
where n, are arbitrary integers, is also a period. 

The periods ,, w,, ..., @, form a system of fundamental periods 
of f(X) if all the periods of f(X) are expressible as linear combinations 
with integral coefficients of these periods and are not expressible as 
such linear combinations of a smaller number of periods. 
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EXAMPLE 8. Let us take f(X) = f(x, %,) = sin x, cos x, on the 
plane £,. It has a system of two fundamental periods, namely, the 
vectors w, (27, 0) and w, (0, 2). We could also take as fundamental 
periods w, and 3; = (22, 27) (in which case w, = 3—@,). 

THEOREM 8, A continuous periodic function of n variables, having 
no manifold of constancy, has a fundamental system of periods con- 
sisting of not more than n periods. 

EXAMPLE 9. Let @,, @2,..., @, be a system of linearly independent 
vectors in E,. Let us form the set A of all vectors (points) of the 
form 

n 
> NyDiy 
i=1 
where the n, are integers. (Such a set is called a net of integers in E,,.) 
We shall write o(X, A) for the distance from the point X € E, to 
the nearest point of A; o(X, A) is a function of X. It has a system 
of fundamental periods consisting of the vectors @,, @2,..., @,. 

ExaMpPLe 10. A continuous function of a complex variable 
S(xtiy) = P(x, y)+iQ(x, y) (mot equal to a constant) cannot have 
more than two independent periods (Jacobi’s theorem). 


5, Passage to ‘the limit for linear envelopes 


Let a, a, ..., @, be linearly independent elements in E. We shall 
write L(a,, a,...,@,) for their linear envelope. If 4, b,, ...,5, 
is another basis in the p-dimensional manifold L(q,,...,a,), then 
Lyj(by, be, - ++, bp) = Ly (Q, a +++ a,). 

Let us consider a family of vectors /,, continuously dependent on 
a parameter «, such that, when a — 2, a, + a(a,xa@,), the expression 
(lag — 4a,)/(%2—%) tends to a vector which we shall denote by di, /da. 
We shall assume that /,,, and /,, are linearly independent whena, #4. 
Having chosen another basis in L,(/,,, /,,): 

lap a, 
Og hy 
we have 
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Assuming that the vectors /, and d/,/d« are linearly independent, 
we find that, as «+a, a,—-a, then the plane L,{/,,, 4.) = 
=Lellays lay (a,)/(2—%2) ) tends to the plane L,(/,, di,/dz). 

Given similar conditions (assuming that the systems of vectors 
lags lags ees ba = where no two of the numbers a, a,...,%, are 
equal, and of the vectors /,, di,/dx,...,d?l,/da?, are linearly inde- 
pendent), we find that, asa,+a(i=1,2,...,p): 


d p-1 
LAE iy ig NE, (\ ae aa): 


Given a family of functions f,(x), dependent on a parameter «, with 
the same conditions and with «, ~ «(i= 1, 2,..., p), we find that 
Lyfe ls Fag), +++ f.,() tends to L,(f,(x), Of (x)/Ox, ..., 


OP-1 Ff (x)/dx?-"). For example, as x, + « (i = 1, 2,...), we have 


Ly (em, 92%, 6.4, e°r®) + Lifer, xea™, ..., xP tee), 


1 1 1 
(= a an =a)* 


L 1 1 1 
PY xma’? (xa? T? (x= a)P]’ 


L,(x™, ROS wy xP) => Ly(a*, x "In Xy vey Xt In?™-1 x), 
LA|x—ay|, |x-ay|) + L,(|x—«|, sign |x—a|). ] 


Let Ag be an n-dimensional, matrix, Aj (i = 1, 2, ..., ) be its eigenvalues 
(simple for « * 0), x,q the corresponding eigenvectors: A a Xia = AigXiq> |X. l=1- 
Suppose that & of the numbers Aa (i= 1, 2,..., kan)tendasa + Oto the eigen- 
value A, of the matrix A,, while the eigenvectors x, (i = 1, 2,..., &) tend to 
the eigenvector x, of the matrix 4, corresponding to the eigenvalue A,. The linear 
envelopes 2, (4) .Aaqe ees Xx, ) now tendtothe linear envelope Ly (x1, %2).. . X4) 
where x, with { > 1 are augmented eigenvectors of the matrix 4, ! Agx;—Ayy - 
=x, (7 = 2,3, ..., 4). 


6. Operators from £, into £,, 


Let Q bea set in £, (which can coincide with E, itself); we associate 
with every element X(x,, Xo, ..., X,) of Q an element ¥(y,, Ya, +s Ym) = 
= f(X) of E,,. We say in this case that an operator f is given from E, 
into E,,, Q being called the domain of definition of the operator. We 
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can also say that we have a mapping f of the set Q of E, into E,, or 
that the operator f performs a mapping of the set Q from the space E,, 
into the space E,,. 


If 
Y= Op Vor vers Vm)  X = Hy Xa 000s Xnds 
Y=f(X), (2.61) 
then 
Vi = SKX) = fii, Xo «0 es Xn)s (2.62) 


where f, is a function of m variables defined in Q, formula (2.62) 
being the coordinate form of writing the operator f, and (2.61) the 
vector form. The functions f; (i=1,2,..., ) are called the components 
of the operator f, and we write 


f= Ai fas +++ Sm) 


Every set of m functions f,(x,, x... %,) (i= 1,2,..., m) 
of n variables defines an operator f from E, into E,,, where f= 
= (fis fas oa +s Sn): 

An ordinary function f(x, %2, . . ., x,) is an operator from £,, into 
£, (into the numerical axis). 

An operator f(X) is said to be continuous in Q if 


Xn ae X 


Nn n—->oo 
X,, and X belong to Q) implies that 
TX) are S(*). 


The necessary and sufficient condition for the operator f(X) = (f,(X), 
JAX), « «+> S_(X)) to be continuous is that all the functions f{X) = f(x, 
Xp, «+ Xp) be continuous in Q. 

For example, the functions 


Z = Ji-xi—x}—3g = VI-|1X1P, 
Ze = XytXotXs3 

yield an operator from £3(x;, x2, X3) into the plane £,(Z,, Z,), defined 

in the three-dimensional sphere || X ||? < 1 and continuous there. 

Functions of a complex variable provide us with examples of operators 

from E, into E, (mapping of a plane into a plane). 
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The term vector function is occasionally used instead of operator 
from E, into E,,. An ordinary function of n variables (n> 1, m = 1) 
is called a scalar function of a vector variable; an operator from E, 
into E, where n> 1, is called a vector function of a scalar variable or 
simply a vector function, and an operator from E, into E,,, where 
n> 1,m> 1, is called a vector function of a vector variable. 

Let ¥ = X(t) be a given vector function, where rf runs over the 
numerical axis (or a segment of it), and let X be a point of £,,. The 
set of points of E,, of the form X(t) is called a curve or line in E,,. 

Linear operators. A linear operator (mapping) from E,,(%4, Xay.0) X,) 
into E,.(¥1, Yer «+ +» Ym) is an operator Y(X) satisfying the conditions: 

(1) YX, +-X,) = ¥OG)+ YG); 

(2) the operator Y(Y) is continuous. 

It follows from conditions (1) and (2) that a linear operator is 
homogeneous: 

Y(AX) = AY(X). 

THEOREM 9. A linear operator Y(X), where Y = (V1, Vos ++ +1 Vino 
X = (Xj, Xe, 0645 Xq), has the form: 

Vie = Ay XyHaigXet 6. +ainXn @=1,..., 2), (2.63) 
ie. every coordinate yX) of the operator Y(X) is a linear function 
of X = (%4, Xe, 065 Xp) 

Every linear operator Y(X) from E, into E,, is defined by a rectan- 
gular matrix 

Az=|laj|| G@=1,2,...,m;, fal, 2,...,), } (2.64) 
Y= AX, 

Conversely, every such matrix defines a linear operator from E, into 
E,, (ia accordance with (2.63)), When m = n, a linear operator from 
E,, into E,, is defined by a square matrix A = |la,ilP} 

Formula (2.63) is the coordinate form of a linear operator (transfor- 
mation) from £, into E,,. 


7. Iterative sequences 


Let 
{Xn} = {Xo X, Xa, ++ 3, Xn = Cris nes +++ Xna) (2.65) 
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be a sequence of vectors in E,, the corresponding k numerical sequ- 
ences being 
{Xni} = {Xois Tris Xais - +} G@=1,2,..., k). (2.66) 
The vector sequence (2.65) (or system (2.66) of numerical sequences) 
is described as iterative if 
Xn =fXna) 1, 2,3, ..9) (2.61) 
where fis an operator from E, into E,. If f = (fi, fo,» »f,), equation 
(2.67) may be written in the coordinate form as 
Xn = SiXn-1, 1 Xn—1,22 ++ +> %n-1, y) @= 1, 2,..., k) 
(2.68) 
On putting Y) = (oi, Xo +--+» Xo,), We can find successively from 
(2.67) or (2.68): 
Xy = (tyr, Nags oe ey Mra), Xe = Car, Xan, ++) Mande +s 


Relationship (2.68) is sometimes written as 


Xni = Fins Xnz +++ Maina Xn-1, is An-1, teas e+) Ana1. bs 
(2.69) 
(When finding the ith component of the mth vector X,, use is made 
of the components Xy1, Xng, «+ +) Xp, ¢-1 already found.) 
EXAMPLE 11. K. F. Gauss considered a sequence of pairs of posi‘ive 
numbers {x,, By} (n = 0, 1, 2, ...) or of plane vectors, where a,, 
Bo are given (% = fy), and 


Spi tPa- 
py = teat Pact Ba = V%nBn- 


As no, the sequences {x,} and {f,} tend to a common limit 


a= lima, = lim f,, — the arithmetico-geometric mean of the num- 
n> 90 N-> co 


bers %, Bg: 
a = ala, By) = a ons |" . 
2G fi SB sare ; 
ce to) 
EXAMPLE 12. Let us take the sequence of a sums s, = 1+ 
+(x/1!)+...+(x"/n!) of the power series for e*. On writing «, = 7, 
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Bn =(x"/n!) we have: (&, Bo, So) = (0, 1, 1). We get an iterative 
sequence («,, 8, 5,) of the form (2.69): 


x 
Sp = Omr1t1, Br = Bags Sy = Spi tBn 


The formula provides a unified scheme for obtaining successively 
(ns Bn Sp) (ie. 5, also) for n= 1, 2,3,.... The unified passage from one 
term of an iterative sequence to the next term is very convenient for 
computation on programme-controlled machines. 

Iterative processes. We can generalize the concepts of § 2, sec. 6, 
to operators from E£,, into E,,. 

Let f be a continuous operator from £, into E,: 


Y=f(X), Y= On Yo -++s Vas X = Oy Xe 0+ + Xn) 
or, in the coordinate form: 
Ve = SMX, Xap +--+ s Xn) G= 1, 2, ..., 7). 
Let us investigate the equation 
X = f(X) (2.70) 
or, in the coordinate form, the system of equations 
Xp fis hs oF (2.71) 
We form the iterative sequence of elements 
Kopi Aas 8 oy Mens el) Xie S (Ses Sass e's Kean) 
where X4(Xq, Xo2 «+ +. Xgn) is an arbitrary element of E,, 
Ximner = SX mn) (m=0, 1, 2,...), (2.72) 
and in the coordinate form 
enacts g IG ein io Sewage: se mad G@= 1, 2,..., ). (2.73) 


If the sequence X,,, is convergent to X*, X* is a solution of equation 
(2.70). 


The solution X* is called a fixed point of the transformation Y= f(X). 


70 MATHEMATICAL ANALYSIS 


8. The principle of contraction mappings 


We introduce a norm into the space E,, (see § 1, sec. 2). An operator 
(transformation) f from £, into £,, is said to be acontraction mapping 
if there is a constant g (0 < q < 1) such that, for any X, X,¢€E£,, 


WFCD-FAN = 914 — XI. (2.74) 


The following theorem provides a condition for the existence of a 
fixed point of the transformation Y= f(X), i.e. of a solution of equa- 
tion (2.70), and at the same time, a condition for convergence of the 
iterative process (2.72). 

THEOREM 10. (the principle of contraction mappings). Jf Y = f(X) 
is a contraction mapping (i.e. condition (2.74) is satisfied with q < 1), 
then: 

(1) there exists a solution X = X* of equation (2.70), i.e. a fixed 
point X* of the transformation Y = f(X); 

(2) this solution is unique; 

(3) whatever the initial approximation Xo, the iterative process (2.72) 
is convergent to the solution X*, 

X*= lim Xp. (2.75) 
M-—> ce 

(4) the sequence X,,, is convergent to X* as fast as the convergence of a 

geometric progression with ratio q, in fact, 


X= Kyl = 7 Xl 2.76) 


We shall mention some sufficient conditions for an operator to be 
a contraction mapping under different norms. It is assumed that the 
functions f(X) = fix, X25 .. +s X,) — the coordinates of the operator 
(XY) — have continuous partial derivatives with respect to all the argu- 
ments. 

For condition (2.74) to be satisfied, (also the consequences of the 
theorem), it is sufficient that: 

(a) in the Euclidean metric, 


yy QS ae By cee =| sq<1; (2.77) 


it j= Ox; 
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(b) in the metric may (see p. 97), 


y PFC, Xan seo Xn) 


Zq<1 © @=1,2,..., 7. 
a Ox; 4g. ( ) 
(2.77) 


Application to the solution of systems of linear algebraic equations. 
Let us take the system of linear algebraic equations 


n 
y= x ijx; + Oy (2.78) 
J=1 
or, in the vector form, 
Y = AX+B, (2.79) 
A= |layjll, B= (y, b,, ..., dy). (2.80) 


Given any initial vector Xo(Xo,, oz) + « -» Xpq), We form a system of 
vectors Xo, X;, Xp, ..-, X, 


ay Mere 
Xm = (mi Xmar sees Xmn)s (2.81) 

where 
Xm = AXm +B (m= 0, 1, 2, ...) (2.82) 


or, in the coordinate form, 
n 
Xm41,i = > Big Xmj +O; G@ = 1, 2,..., m). (2.83) 
j=l 
It follows from (2.77) and (2.77') that a sufficient condition for con- 


vergence of the vector sequence X,, as m — oo to the vector solution 
X*(xj, xg, «+ +5 x2) of system (2.79) or system (2.78) is that 


3 


n 
(a) 1a =a<1 
i=1j=1 
or 
a . 
(b) Lihegl =a = i=1,2,...,”) 
= 
(q=maxq; i=1, 2,..., 2), 


the accuracy || X*—.,,|| of the mth approximation X,, being defined 
by (2.76); in case (a) the norm is Euclidean, in case (b) it is Mn) 
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§3. Convex bodies in 7-dimensional space 


The theory of convex bodies in n-dimensional spaces was developed 
by G. Minkovskii; it has found applications in numerous problems of 
analysis, geometry and number theory, and more recently in new 
branches of applied mathematics: in the theory of games and in linear 
programming. This theory provided the basis for developing the the- 
ory of n-dimensional normed spaces, the infinite-dimensional generali- 
zation of which plays an important role in analysis. 


1. Fundamental definitions 


A convex set in space E,, is one which contains, in addition to two 
points A and B of the set, every segment joining these points. 

Particular cases: a convex domain Q is a domain which is a convex 
set, a convex body Q is the convex domain Q together with its boundary 
I. Points of the domain @ are called interior, and points of I" boundary 
points of Q. 

On a Straight line, an interval is a convex domain, and a segment a 
convex body; on a plane, the interior of a circle or triangle is a convex 
domain and the circle and triangle (including their boundaries) are 
convex bodies; in three-dimensional space, the interior of a cylinder, 
sphere, cube are convex domains, and the cylinder, sphere and cube 
(including their boundaries) are convex bodies, the sphere and cube 
being bounded convex solids, and the cylinder an infinite convex solid. 

A closed convex set, lying in a k-dimensional plane and not lying 
in any (k—-1)-dimensional plane, is called a k-dimensional convex 
body (0= k =n). A point will be described as a zero-dimensional 
convex body. (The empty set is also regarded as convex.) 

A convex body (set) may be bounded or unbounded (cf. the above 
examples). We can quote as an example of an unbounded convex body 
a half-space in E,, i.e. the set of points X satisfying the inequality 
({¥ = C), where f is a linear functional in E,, and C a constant; 
the whole of the space Z, and any hyperplane in it are examples of 
unbounded convex sets. 

The intersection of convex sets in £,, is a convex set, the intersection 
of convex bodies in E, is a convex k-dimensional body (k = n), 


N-DIMENSIONAL SPACES AND FUNCTIONS DEFINED THERE 73 


A convex polyhedron is a closed convex body — the intersection of 
a finite number of half-spaces. 

The convex envelope of a set M in E, is the set Q of points X¢ E, 
expressible in the form 


l 
X= YAN, (2.84) 
i=1 


where / is any integer, / = n, X, are arbitrary points of M, A, are arbi- 
trary non-negative numbers satisfying the condition 


EXAMPLE 13. The convex envelope of a pair of points A and B is 
the segment joining them; the convex envelope of three points not 
lying on a straight line is a triangle; the convex envelope of four points, 
not on the same plane, is a tetrahedron with vertices at these points. 

The convex envelope of a set M is the intersection of all convex sets 
containing M, or the least convex set that contains M. Every bounded 
convex polyhedron is the convex envelope of a finite number of 
points — the vertices of the polyhedron. 

Limit points. A point A is a limit point of a convex body @Q if A 
is not an interior point of any segment belonging to Q. 

Every limit point of Q is a boundary point of Q; but not every bound- 
ary point is a limit point. For example, only the vertices of a polyhe- 
dron (polygon) are its limit points. In the case of a circle and sphere, 
all the boundary points are limit points. In future, a convex body will 
be taken to mean a bounded convex body. 

A convex body Q is the convex envelope of its limit points. 


2. Convex functions 


A function f((X) = f(x, xg, ..., X,), defined in E, (or ona convex 
set QO of E,,), is described as convex if, givenany X and Y of E, (of Q), 
we have 


177) = put +7 (2.88) 


(and concave, if the reverse inequality is satisfied). 
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A convex function also satisfies the more general inequality: 


JU -)X+tY] s A-DAN+ HX) (2.85' 
for any 7 € [0, 1]. 
(See Chapter I, § 3, sec. 17, for convex functions of one variable.) 
If f(X) is a convex function, cy is a lower bound in E,, (in Q), the 
set of points of E,, (of Q), satisfying the inequality 
SX) 8 ¢, 


with any c = Co, is a convex body (set). 


EXAMPLE 14, On the plane E, (x,, x2), the functions 
Gry He) = (x1 [P+ | me PY? 
with p = 1 areconvex functions. Asp-~ =, f,(x1, x2) tends to the function f..(%;, ¥2) = 
= max(|x,|, |x21) (see Fig. 2). The sketch illustrates the curves f,(x,, x;) = 1 


for different p. They all pass through the points A, (1,0), 4,(0, 1), A; (—I, 9), 
A, (0, —1). 


The curve f,.(%;, %2) = 1 is the boundary of the square with vertices A), Az, 
Ay, Ay. 

The curves f, = 1, where J] < p < ~, lie between these two curves. 

The curve f, (x;, X2)=1 is the circle of radius 1. 
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The figures f, = 1, bounded by these curves, are convex. When p<1, such 
figures are no longer convex. For instance, when p= 2/3, we get a figure bounded 
by an astroid. 


3. Convex bodies and the norm of a vector 


Let Q be a convex body in E,, having 4 as an interior point. Every 
point X of , can be written (uniquely, when XY ~ 6) as X¥ = AX, 
where A> 0, X, is a point of the boundary of Q. If Xlies outside Q, 
then 24> 1; if X lies inside Q, A < 1;if X lies on the boundary of Q, 
A = 1. The point 0 can be written as 0.X, (i.e. A = 0 for the point 6). 

We now define a function p(X) in £, as follows: at the point 
X= 4X), 

PAX) = 4; 


P(X) is greater than, equal to, or less than 1, depending on whether 
X is outside, inside, or on the boundary of Q respectively, 


%Q(8) =0. 


Po(X) is a convex function. The body Q is the set of points of £, for 
which p,,(X) = 1, while the boundary of Q is defined by the equation 
P(X) = 1. 

Pq(X) has the following properties: 

(1) Pg(X) = 0, where yg = 0 only when Y = 9; 

(2) WhenA = 0, 9.(4X)= Ag g (X) implying a positive homogeneous 
function); 


©) Pq(X+Y) Gq (X)+ 99 (¥)- 

If Q is a central symmetric convex body with centre at 6 (ie. XE Q 
implies ~ X € Q), we have the additional property: 

PQ(AX) = |Algo(X) for 1A<0. 

Property (2) becomes the stronger property: 

(2') PQlAX) = 14] PQ(X) 
for any real 4. If p is a given function satisfying conditions (1)-(3), 
the set Q defined by p(X) = 1 is a convex body, while it is a centrally 


symmetric convex body with centre at 8 when condition (2’) is 
satisfied. 
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The Euclidean norm || X'|| of the vector X € E,, satisfies conditions 
(1), (2), (3). We can generalize the concept of norm of a vector in 
n-dimensional space: the norm can be taken as any function 9(X) 
that satisfies conditions (1), (2), (3). We shall write E, , for such a 
space. 

Tf || X]| = ~(X), conditions (1) - (3) can be rewritten as: 


(1) || X}f 2 0, and || X]| = 0 only when XY = 0; 
(2) When A> 0, we have ||AX |} = A][ X]|; 
(3) [| X+Y] = ]XW+[) VII (the triangle inequality). 


When ¢ is even, condition (2) is replaced by the stronger one: 
(2’) AX] = [A] |] X11 for any a). 


Spaces £,, in which a norm is introduced, satisfying the above 
conditions, are said to be normed. For instance, Euclidean spaces are 
normed (see § 1, sec. 7). 


4. Support hyperplanes 


n 
Let us take the linear form fX¥ = x ix, in E,, the hyperplane 


t=1 
(fX = C)and the half-space (fX = C). We call ({(X¥ = C) a hyperplane 
of support for the convex body Q if Q lies wholly in the half-space 
(fX = C) and the hyperplane has points in common with the boundary 
of Q. 

EXxamPLe 15. In the two-dimensional case, the hyperplanes of support 
reduce to lines of support. In the case of a circle, the lines of support 
are the same as the tangents. In the case of a triangle, the lines of 
support are the three lines along which its sides lie, together 
with all the straight lines passing through its vertices and lying in 
its exterior angles. In three-dimensional space, hyperplanes of sup- 
port become planes of support; for a sphere, the planes of support 
are its tangent planes, and for a cube, its boundary planes and the 
other planes that pass through the intersection of two sides, or 
merely through a vertex and do not cut the interior of the cube. 

Let the equation of the hyperplane of support be 


fX=C, (2.86) 
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THEOREM 11. The number C on the right-hand side of (2.86) is defined 
by the equation 


C = max fx. (2.87) 
xXeEQ 


The equation of the hyperplane of support therefore has the form 


fX = max fx. (2.88) 
XEQ 
THEOREM 12. The linear function fX attains its maximum C on Q 
at a limit point of Q, i.e. the intersection of (fX = C) and Q contains 
a limit point of Q. 
Coro ary. Every hyperplane of support of a body Q passes through 
one of its limit points (in particular, each hyperplane of support of a 
polygon passes through one of its vertices). 


5. Support functions and conjugate spaces 


Let the norm || X|| = y,(X) be introduced into space £,, and let 
Q be the closed unit sphere: Q = (|| X|| S 1); Q is a convex body in E,. 
If 
n 
is 
is a linear form in E, = £,,,, the corresponding hyperplane of support 
of Q is given by the equation 
IX = C(= max IX). (2.89) 
WX iS1 
Every linear form /X is a vector / with components /,, Jo, ..., 1. The 
set of such forms makes up an n-dimensional linear system L,. A norm 
can be introduced into L,,, i.e. we can put 
Hit = ypO= max Lx. (2.90) 
i} X |] 2 
This norm satisfies, along with the norm || X||, conditions (1), (2), 
(3) (see sec. 3) or (1), (2’), (3). 
We have: 
UX] = IIL. (2.91) 
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This inequality is a generalization of inequality (2.7) for the Euclidean 
metric, Equation (2.89) can be written as 


IX = |[|]*. (2.92) 
Conjugate Spaces. The space L, = £,, thus introduced, of linear 


forms in E,,, is described as conjugate to the initial space £,,,. 
The following notation is used: 


Eny = Eng (2.93) 
The conjugate to a Euclidean space is also Euclidean. 


THEOREM 13 (Minkovskii). If the spaceE,,, is regarded as the initial 
space, its conjugate becomes E,,, 


jpeg (2.94) 


(the conjugate to the conjugate space is the initial space). 

The reciprocal property whereby spaces E,, and E,, are conjug- 
ates of each other is known as reflexivity. Functions p(X) and y(J) 
are said to be reciprocal; they are connected by the relationships 

max 1X = y()), max IX = ¢(X). (2.95) 
PHAVEL ps1 
Similarly, the convex bodies Q and Q*, defined by the inequalities 
pX = 1, pl = 1, are also said to be reciprocal, (Minkovskii’s theorem 
is no longer in general true for infinite spaces.) 

EXAMPLE 16. Let J, ,(p = 1) be an n-dimensional space with the 

norm 


XI = (z I; ry”. 


When p> 1, we have [}, , = In,» where (1/p)+(1/q) = 1. 
When p = 2, (the case of a Euclidean norm) we have g = 2 (the 
n-dimensional Euclidean space /, is self-conjugate: [, » = J, »). 
EXAMPLE 17. Let /, , be an n-dimensional space with the norm 


n 
IX = ¥ lab 
i=1 


and m,, an n-dimensional space with the norm 


WY] = max( yl, yeh ---> (yal: 
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we have: 
ee * 
hh, 1= My My = fn 1 


Every linear function YX in E,, can be regarded as the scalar 
product of a vector X of £,, and ¥ of £,, 


3 


6, Fundamental theorems on support hyperplanes 


THEOREM 14. Let Q be a convex body in n-dimensional space E,. 
A hyperplane of support of Q can be drawn through every point of 
the boundary of Q. 

The following is a generalization of this theorem: 

THeoreEM 15, Let L, (k < n) be a k-dimensional plane drawn through 
an interior point A of the n-dimensional convex body of E,,. It cuts from 
Q ak-dimensional convex body Q,. Let Ly_, be the (k—1)-dimensional 
plane in L, which is a support plane for Q,. An (n—1)-dimensional 
hyperplane L,,_, can be drawn in E,, which is a support hyperplane for 
Q and contains L,_,. 

Let 1,X be a linear form in the k-dimensional manifold E, c E,- 
(1 3 k <n). The linear form /,X in the whole space £, is called an 
extension of the form /, if, for X ¢ E,, 


1,X = 1X. 
The form /, in L, has the norm 


all, = = max 1X, 
Wxns1 Xe 


The form /, in £,, has the norm 


Wall = (Alle, = max 2X, 
WX S21 
It follows from this that |]/,|] = {l/,[lz,, ie. when a linear form is 
extended, its norm can only increase. 

THEOREM 16, Any linear form 1,X, defined in a k-dimensional manifold 
L, of E,, 1S k <n, can be extended to the whole of space E,, without 
changing the norm. 

This theorem can be extended to infinite spaces (the Hahn-Banach 
Theorem). 
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7. The connection between reciprocal convex bodies 


Let Q and Q* be unit spheres in E, and E, . A duality (not one-to- 
one) can be established between the points of their boundaries. 
Equation (2.89) of a plane of support of Q in E, can be written as 


n 
YX = 2 Poim =1. 
& 


In this case (see (2.92)), || Yq |[* = 1. Formula (2.92) becomes 
¥)X= | Yoli* = 1. (2.96) 


We associate with every point X, of E,, for which || Xq|| = 1 (ie. 
points of the boundary of Q), all the planes of support of Q passing 
through it, these planes having equations of the form (2.96). We have: 


YoXo=1, || Xoll = ll Poll* = 1. (2.97) 


Formula (2.97) yields an expression for the ¥, €*,, which correspond 
to a given X, ¢E,; it has symmetry with respect to X, and Y,, 
which points to the reciprocity of this mapping. 
Theorem 14 shows that every X, of the boundary of @ (||X,||= 1) 
has at least one associated Y, of the boundary of Q* (||Y||* = 1). 
EXAMPLE 18. On the plane mp, the sphere 


CX] = max (jay {, [a21) = 1) 


is the square Q= B,B,B,B,; on the plane 2, the sphere (/|¥||= 
=|y,!+ |y2| = 1) is the square O* = A, A,A34,4. Corresponding to the 

point X, (1, 1) = B, of the boundary of the square Q, we have the 
Yo(v1, ¥2) for which 


1 = YoX = MyXytMe%. = Mt: WYVoll = Inl+lel = 1 
Le. y,=|y,| = 0, Yo= lye] = 0. 


These points thus fill the side A,A, of the square Q*. 

The side B,B, of the square Q lies on the support line X, = 1, ie. 
1.X,+0.X, = 1. The corresponding point is Y,(1, 0) — the vertex A, 
of the square Q*, The remaining sides of Q* correspond to the remain- 
ing vertices of Q, the vertices of Q* to the sides of Q and vice versa. 

In three-dimensional space the convex bodies Q and Q* can only be 
convex polyhedra simultaneously, the vertices of Q being associated 
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with the faces of Q*, the ribs of Q with the ribs of Q*, the faces of 
Q with the vertices of Q* and vice versa. Such polyhedra are said 
to be reciprocal, For instance, if Q is a cube, Q* is an octahedron (and 
vice versa); if @ is a dodecahedron, Q* is an icosahedron (and vice 
versa). 

In the n-dimensional case Q and Q* can only be polyhedra simul- 
taneously, the k-dimensional faces of Q (0 Sk = n—1) being associat- 
ed with the (n—k-— 1)-dimensional faces of Q*. 


8. The cone. The tangent cone 


A cone K in E, with vertex at X) € E,is a set of points of £,, differ- 
ent from the whole of E,, and such that, if X belongs to K, the entire 
ray (tX), 0S t < <, belongs to K. We shall assume without any 
proviso that the cone K is a convex body. A cone, together with two 


Fic. 3. Fic. 4. 


of its rays forming an acute angle, contains the entire angle. Cones 
on a plane are angles not exceeding z. In three-dimensional space 
examples of cones are provided by dihedral angles not exceeding =, 
ordinary circular cones or regular pyramids, continued indefinitely, 
etc. 

Let X, be a point of the boundary of a convex body @ in £; let 
us write K(X,) for the least cone with vertex at X that contains Q; 
this cone consists of all the rays joining X, with points of Q and all 
the limiting rays. We shall call the boundary of this cone the fangent 
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cone hypersurface to Q at the point X); two cases are possible: 

(1) The cone K(X) coincides with the entire half-space, its 
boundary is the unique hyperplane of support at ) to Q, which 
“touches” Q at the point Xp. 

(2) The cone K(X,) is a regular part of the half-space; an infinite set 
of hyperplanes of support of Q passes through the point X,. Such a 
point will be called a point of sharpening. 

EXAMPLE 19. On a plane, thecone K(X,) becomes an angle bounding 
two tangents to Q at the point X) = 0 (the rays OA, OB in Fig. 3); 
if this angle is equal to x, both rays form a unique support line (the 
line A’B’ in Fig. 4), tangential to the boundary of Q at the point O. 
If the angle is less than z, the point O is a point of sharpening, and 
an infinite set of support lines pass through O. 

EXxaMPLeE 20. Let Q be a convex polyhedron in £3. If the point X 
lies inside a face, K(X) is the half-space bounded by the plane of the 
face, which is the unique support plane of Q at Xq. If Xo lies inside 
a rib AB, K(X,) is a dihedral angle less than 2, formed by the planes 
of the faces that intersect in 48; there is an infinite set of support 
planes to Q at Xp, all of which pass through the rib AB. If X, is a vertex 
of QO, K(X,)isa polyhedral angle with vertex at X,, bounded by the 
planes of the faces that meet in Xp; points of the ribs, and all the more 
the vertices of Q, are points of sharpening. 


9. Helly’s theorem 


An interesting theorem on the intersection of convex bodies must 
be mentioned. 

THEOREM 17. Let {Q} be an arbitrary set of convex bodies given in 
E,, at least one of which is bounded. If any n-+-1 of them have a common 
point, there is a point common to all the bodies of {Q}. 

For instance, if an arbitrary set of segments, such that any pair 
has a common point, is given on a straight line, there is a point common 
to all the segments. 
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10. Linear operations on sets 


DeFinition. Let A and B be any sets of E,,. The vector sum A+B of 
these sets is defined as the set (X) of points of E,, expressible in the form 
X = X14, where X,¢€ A, X,€ B. 

Example 21, If A is an arbitrary set, a a point (vector), then 4+a is 
the set obtained by parallel displacement of the set 4 along the vec- 
tor a. ; 

EXAMPLE 22. If A is the x-axis, B the y-axis, A+ Bis the entire plane. 

EXxamPLe 23. If A in £, isan n-dimensional closed sphere of radius 
@ with centre at 6, A+B isa “layer” of thickness 9 round B, i.e. the 
set of points of £, at a distance less than or equal to 9 from B. 

THEOREM 18. The vector sum of convex sets (bodies) is a convex 
set (body). 

DEFINITION. [fA is a number, Aa set in E,, AA is the set of all points 
of the form AX, where X € A. 

A similitude transformation of the set A with transformation coeffi- 
cient 4 > 0 is a transformation of the set A into the set AA. A symmet- 
ric mapping of A with respect to the centre # is a transformation of 
A into —A. 

When A = 0 the set AA consists of the single point 0. 

If A is a convex set (body), AA is a convex set (body). 

n 


If A; @ = 1, 2, ..., 2) are convex sets (bodies), } 2,A, is a convex 
i=1 

set (body) for any system of non-negative numbers 4,, A,, ..., 4). 
Let T, (J = C,) and T;, (J = C,) be two parallel hyperplanes of support 
of the convex bodies Q, and Q,, while (/, = C,), (4 = C,) are the corres- 
ponding half-spaces containing Q, and Q, respectively; #,, fp are arbit- 
rary positive numbers. Now, t,7,+%7> is a hyperplane of support 
parallel to them (/ = t;C,+1,C,) of the body Q = 4,0;+ t,Qz, lying 
in the half-space (/ S 4,C,+t%)C,). 

THeorem 19 (Brunno-Minkovskii). Let A, and A, be convex bodies 
in E,, and A, = tA4g+(1—f)Ay, 0S ¢ 31, @ “linear system” of convex 
bodies; the n-dimensional volumes J,, of the bodies Ap, A, and all the 
A, are connected by the Brunno—Minkovskii inequality 


Voalad = L—1)9/Ta(Ao) +2 Jnl Ay)- (2.98) 
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The case of equality occurs if and only if Ay and A, are homothetic convex 
bodies, i.e. one is obtained from the other by a similitude transformation 
and parallel displacement (A, = tAy+b, t = 0, b is a vector). 

Inequality (2.98) was proved by Brunno (in 1887); the case of 
equality was proved by G. Minkovskii (in 1891). 

Inequality (2.98) implies that VIAAD is a concave function for any 
tin 0, 1}. 

The theorem still holds for non-convex bodies, and in genera] for any sets, 


if J,(A) is understood as the exterior -dimensional measure of the set A or the 
measure when it is measurable (see ref. 7). 


The Brunno-Minkovskii theorem is employed in proving the iso- 
perimetric and numerous other geometric properties of convex bodies. 


CHAPTER Ill 


SERIES 


Introduction 


Infinite sequences and their limits have been discussed in Chap- 
ter I. Infinite series, or simply series, are closely connected with 
sequences, e.g. 


Qt+ag+...+a,+...5 YF ay 3.1) 


is “the sum of an infinite number of terms”. 

Series are commonly employed in the most widely spread branches 
of mathematical analysis and in the solution of applied problems, 
since they represent one of the most universal and effective means 
both of investigation and computation. 


Examples of series (infinite geometrical progressions) were known to the 
mathematicians of antiquity. In the process of developing the analysis of infinitesi- 
mals, series made their appearance, with the aid of which the values of various 
functions ‘could be computed: Mercator’s series for the logarithm, Newton’s 
series for sin x, cos x, arc sin x, arc cos x, (1++x)%, etc. Series were widely used by 
Euler for representing functions in various works; in addition to power series, 
trigonometric series were employed by Euler. He also made use of divergent 
series, and seems to have been the first to be concerned with improving the converg- 
ence of series. The vast amount of factual material on series that had accumulated 
by the beginning of the nineteenth century posed to scientists the problem of 
finding a strict basis for the theory of series. The investigations of Abel, Gauss, 
Cauchy and others in this direction played an important part in laying the foundat- 
ions of mathematical analysis as a whole. 


The present chapter is devoted to the basic theory and practice 
of evaluating series. Numerical series are considered in § 1, functional 
in § 2, and the various methods of computing them in § 3. (See 
Chapter IV for vector series.) 


85 


86 MATHEMATICAL ANALYSIS 


1. Basic concepts 


DEFINITION: A series is defined as in (3.1), composed 
terms of an infinite sequence {a,} (n = 1, 2, 3, ...). For 
series there is a corresponding sequence {s,} (n = 1, 2, 3, 
partial sums, where 


n 
S= Ay Sy = Atay, 166, Sp= Di ayy ieee 


EXAMPLE 1. Given the series 


1 1 1 2 
lt+s+gtat = ¥ aps 
we have 
4 a) 1 
s = 1, 2= > eee ss n> l-ay gid seers 


of the 
every 


...) of 


(3.2) 


The following two cases are possible when considering the sequence 


of partial sums. 
Case 1. The sequence {s,} has a definite finite limit 


S= lim s,. 
nN co 


This limit is called the sum of series (3.1) and is written as 


In Example 1, 
oo J \n-1 3 
ae (3) map 


Case 2. The sequence {s,} has no finite limit. 
EXAMPLE 2, 


142434 ...¢n+...= Don; 
nel 
s,= 1, B38 ey oy OE ‘| 


As n-— oo, the partial sum s, ~ oo. 


(3.3) 
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EXAMPLE 3. 
Ini See 5 Set 
n=1 
Q when a is even 
Ss =1, ,=0, 5=1,....,5,= ? 
: i . 1 when 7 is odd. 
EXAMPLE 4. 
1-24+4-8+...= ¥ (—2)*-3; 
nal 
1—(—2)" 
SZ=1 sg=—-l, ss=3, 4 = —5,..-, er none ae 


In Case | the series is said to be convergent, whereas it is divergent 
in Case 2 (Examples 2, 3, 4). 

Example 2 illustrates an important particular case of a divergent 
series, when 5s, + oo (or 5, +— oc); Example 3 illustrates the case 
when s,, oscillates while remaining bounded, and Example 4 the case 
when 5s, oscillates but is unbounded. 

We shall only discuss convergent series in this section. In the case 
of a convergent series (3.1), the sum S can be written as 


S=5,+Rny (3.4) 
where 
Rn = Qnartangnt e+e = ae (3.5) 
Ren+1 
is called the remainder or remainder term of the series. 

Evaluation (or summation) of a series implies finding its sum S, 

We must therefore verify the convergence of a series before finding 
its sum. 

Strict summation (some methods of which will be given below) 
is only possible for a narrow class of series. For the majority, the 
sum is found approximately. In approximate summations, the sum 
S is replaced by the partial sum s,. 

It follows from the definition of the sum of a convergent series 
that 

lim R, = lim (S—s,) = 0. (3.6) 
n> % 


n—> oo 
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This indicates that, given a sufficiently large m, the absolute value 
of the remainder term R, can be made as small as desired. 

To ensure the required accuracy when replacing S by s,,, it becomes 
necessary to estimate the difference 


S—s, = Ry, 
i.e. the remainder term. 

In addition, practical convenience in computations requires that 
the number n of terms of the partial sum s,, required for achieving 
the necessary accuracy, be not too large. Reasonably accurate summa- 
tion of certain series would require taking thousands, or even tens 
of thousands, of terms. Such series are said to be slowly convergent. 

ExamPLe 5. To compute the sum of the series 


ee ee | hed 1 
1-=+ +...= ¥(-pr 
‘ n=l n 


2°3 4 
to an accuracy of 0-001, the summation of a thousand terms is needed. 
The question thus arises of improving the convergence of a series, 
ie. transforming it in such a way that summation of the transformed 
series with the same accuracy requires a smaller number of terms 
in the partial sum s,. The fundamental questions for the summation 
of series are therefore: convergence, estimation of the remainder 
term, improvement of the convergence. 


2, Some convergence tests for series 


Cauchy’s test for the convergence of a sequence (3.2) takes the 
following form as applied to series. 

Caucuy’s Test. The necessary and sufficient condition for converg- 
ence of the series (3.1) is that, given any e>0, there exists ann, such 
that : 

l@ngit@ngat +++ t@neml < & 


for alin>n, and any integer m. 
An important corollary follows from this test with m= 1. 
If series (3.1) is convergent, its general term a, tends to zero as n 


increases: 
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This condition is necessary but not sufficient for convergence. 
EXAMPLE 6. The harmonic series 
1 1 = 1 
l+s+5+...= _ 
heise ae > 
is divergent, although a, = l/n +0 asn + o, 

Cauchy’s test is the most general necessary and sufficient criterion 
for the convergence or divergence of a series. 

Direct application of it is difficult, however. The theory of series 
includes a whole range of sufficient tests for convergence and diverg-. 
ence of varying degrees of generality, and widely employed. Histor- 
ically, the first of these is 

D’ALEMBERT’S TEST. Jf the limit 

jim Lani! — g 
Tl—> oo | ay, | 
exists for series (3.1), the series is convergent when q<1 and divergent 
q> 1. (The test is inconclusive when q = 1). 
A more general test is 
Tue Caucny-HaADAMARD Test. We write 
q= lim Vian]. 
n> oo 
Series (3.1) is now convergent when q<\ and divergent when q>1. 
(The test is inconclusive when q = 1.) 
THE PRINCIPLE OF MAJORANT SERIES. The series 


bytht...= Y Dp (3.7) 


with non-negative terms 6, is said to be majorant for series (3.1) if, 
given any n, 
|@n| 3 by 

as from some n 2 N. 

The convergence of series (3.7) implies the convergence of series 
(3.1). 

Numerous convergence tests are based on the principle of majorant 
series, including in particular the d’Alembert and Cauchy-Hadamard 
tests, 
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§ 1. Numerical series 


1. Alternating series and series of constant sign 


If all the terms of a series are of the same sign, the series is said 
to be of constant sign. Such series include those, all the terms of 
which are positive (positive series), and those, all the terms of which 
are negative (negative series), 

If all the terms of a series are not of the same sign, the series is 
described as alternating. When there is a finite number of terms of 
the same sign, they can be neglected when investigating the converg- 
ence and attention paid only to the remaining series of constant 
sign. The theory of series with an infinite number of positive and 
negative terms has certain differences in principle from the theory 
of series of constant sign. 

The following is a particular case of the principle of majorant 
series. 

THEOREM 1. The series 


A+Qt+ ...+a,+...= Vay (3.8) 
with terms of arbitrary sign is convergent if the series 
[aq l|+laj}+...+la,J+...= Y lanl (3.8*) 
n= 


formed from the absolute values of the terms of series (3.8), is convergent. 

In this case series (3.8) is described as absolutely convergent. All 
series of constant sign are absolutely convergent. 

Cases are possible when series (3.8) is convergent, and series (3.8*) 
divergent. Series (3.8) is then described as non-absolutely, or condi- 
tionally convergent. 

EXAMPLE 7. The series 

1 1 es (—1)""1 
ae Maar ace ed oh, on 
is convergent and its sum is S = In 2. 

On the other hand, the series of the absolute values of the terms 

is the divergent harmonic series. 
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2. Properties of convergent series. The associative property 


If the terms of the convergent series 


Qtat...taat...= Vay 


are grouped in any manner, without changing their order: 


Gi via Paine Guar b 4st Hig Gaayt vad tong es 
o> Qyyytit -++ Tan --es 


where {n,} is a partial increasing sequence of numbers of the natural 
series, the series of the sums of the terms of these groups 


(A, + 66. Hn + Gnmtit +++ Han) +... 


is always convergent and has the same sum as the initial series. This 
property can be utilized for improving the convergence of series. 
The rearrangement property of absolutely convergent series. If the 


series > a, is absolutely convergent, the series obtained from it 
net 

by any rearrangement (commutation) of the terms is also convergent 

and has the same sum as the initial series. : 

Non-absolutely convergent series do not have the commutative 
property. We have, furthermore, 

THEOREM 2 (Riemann). The terms of a non-absolutely convergent 
series can-be rearranged in such a way that the transformed series 
has a sum equal to any previously assigned number, or becomes di- 
vergent. 


3. General tests for the convergence of series of positive terms 


If we want to determine the convergence of the series with positive 
terms 


> Ans (3.9) 
Rel 
we choose at discretion another series with positive terms 


v by (3.10) 


kel 
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such that its convergence and sum are already known to us. 
We introduce the notation: 


Rn = ¥ ay; (3.11) 
kam 


R,, is the remainder term of the series, which is equal to a finite posi- 
tive number if series (3.9) is convergent, and to o, if series (3.9) 
is divergent; 

b 

AM =—*, (3.12) 

Onset 
where / is a parameter taking integral values such that m+/= 0, 
m is a fixed positive integer; 


lim 4,() = AQ, (3.13) 
pererey = 
jm AD) = AD. (3.14) 
Let 
lim} bp = Bm 3.15) 
fm } b= Ba: (3.16) 


in the case when the lower and upper limits coincide, i.e. when the 
limit exists, we introduce the notation: 


on AMD) = AD, 3.17) 


Him 3. bp=Byp (3.18) 


neo kam 


We have the following sufficient tests for convergence of series 
(3.9). 

Test 1. If A() > 0 and B,, < + ©, series (3.9) is convergent, whereas 
if —0 <A(l) = 0 and B, = — &, the series is divergent. 

Test Il. If AQ) <Oand B,.> — co, the series is convergent, whereas 
if 0 = AD) < + ~ and B,, = + ~, the series is divergent. 
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Test Ill. If A) > 0 and B,,< + or A()<0 andB,,> — ~, the 
series is convergent; if0 = A(!) < + and B,=+ or—«0< A()NS0 
and B,, = — ©, the series is divergent. 

By a suitable choice of auxiliary series (3.10), we can obtain 
as particular cases from Tests I, II and IH either new or already 
familiar sufficient tests for the convergence of tests with positive terms 
(see sec. 5), These tests include, in particular, the familiar necessary 
condition for convergence which says that, if series (3.9) is convergent, 

lim a, = 0. 
NR co 


4. Remainder term estimates corresponding to the various 
convergence tests 


When one of the convergence Tests I, II, III is satisfied for series 
(3.9), a corresponding estimate of the remainder term can be given. 
(1) For Test I: 


Bm Bn 
“at Ay) = Bt = ap Auld’ ne 
k=m kam 
where m is such that all the A,(/)>0; / is an integral parameter, 
satisfying the condition m+/z2 0. 

(2) For Test II: 


Bn B 
nf 4, = Rimnst = ap A” (3.20) 
k=m k=m 
where m is such that all the 4,(/) < 0 and m+/= 0. 

(3) For Test III, if A()>0, inequalities (3.19) hold, while (3.20) 
hold if A() < 0. 

For Test IE, it becomes convenient to utilize the following par- 
ticular cases of (3.19) and (3.20): 

(a) When A(/)> 0 and the sequence {A,(/)} is monotonically in- 
creasing for k =m, we have 


Bm Bn 
A) S Roi = A, . (3.21) 
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(b) When A(/)<0 and the sequence {A,(/)} is monotonically 
decreasing for k = m, we have 
Bm BA 
4, SRnas Ss AW . (3.22) 
(c) When A()<0 and the sequence {A,()} is monotonically 
increasing for k = m, (3.21) holds. 
(d) When A() > 0 and sequence {4,(J} is monotonically decreasing 
for k = m, (3.22) holds, 
EXAMPLE 8, Let us estimate the remainder term of the series 
1 
On putting, say, b, = 2,_,—-Z,, Where z, = —1/2n?, we have, 
provided that m> 1 and /2 0: 


_ Qm+1)n+d3 
An(!) = 2mm+1) ” 
autem e oe at an! 
AX) = Sasi =1, Bn= fim ns ~ 2m) =a 


It is easily verified that the sequence {4,,(0)} (m= 1, 2, 3, ...) 
is monotonically increasing, while the sequence {A4,,(1)} (m = 1, 2, 


3, ....) is monotonically decreasing. 
Consequently, when / = 0 and m = 1, we have by (3.21): 
1 (m+ 1)? 


Gt ~ Rm =~ Gap ’ 
while with / = 1, by (3.22), 
See See eee 
Qm+1)(m+1I +1 2m 
We obtain from the last two inequalities, in choosing the greatest 
lower and least upper values, 
1 (m+1) 
Qm—1)m sig (2m+ 1)m3" 
This example shows that, given the same choice of sequence {b,,} and 
different values of the index /, estimates can be obtained that do not 
overlap each other. 
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5. Special tests for the convergence of series of positive terms. 
Estimates of the remainder term 


Numerous familiar classical tests for the convergence of series 
with positive terms follow from the general convergence Tests I, II 
and III (sec.3), We shall give here certain of these and the corres- 
ponding remainder term estimates (see ref. 9). 

1°, THE GENERALIZED D’ALEMBERT TEST. The following two tests 
can be regarded as a generalization of the d’Alembert test mentioned 
above. : 

Test A. If, for a fixed l, 

AQ = iim S417" — 9, (3.23) 


n—>co Any] 
0 


the series ). a,, is convergent, whereas the series is divergent if 
nel 


AQ) = lim “#1, 9, (3.24) 


noe ntl 


Test B. If, for a fixed l, 
AZ) = lim Sn+17 4 
neo ny] 


is negative, the series is convergent; whereas if the limit is positive, 
the series is divergent. 

In particular, when / = 0 Tests A and B yield d’Alembert’s test 
(Introduction, sec. 2). 


If the convergence of the series } a, is established with the 


nel 
aid of Test A or B, we have on the basis of (3.20): 


—a, —a 

——__*— 5 Rng S ———™—__.. (3.25) 
inf 2h+17 Se sup 2k+t— 9k 

kR=m st k=m ORGt 


If the sequence {A,(/) = (4,,,—4,)/4,4,} is monotonically in- 
creasing for k = m, we have 


—an 


a a (3.26) 
lim R+1 Rk 
Amst k>c Anat 
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If the sequence {A,(/)} is monotonically decreasing for k = m, 
we have 


— a. — a, 
: ‘m - = Rina S aT Fis =o ‘ (3.27) 
lim R+i k mM+1 m 
ke | Ah4 Amst 
EXAMPLE 9 
= i 
Pe (3.28) 


It is easily verified that, if /+1 <0, the sequence {4,() = (a,,,— 
—4,)/@,,,} for series (3.28) is negative and monotonically decreasing 
as from a certain k = N(J). If /+1 > 0, the sequence {A,(/)} is negative 
and monotonically increasing. 

We therefore have, on the basis of (3.27) with /4+1 = 0, as from a 
certain m 2 N(J) (say as from m2=1 when / = —1): 


1 (m+? 
Brig = Rat = ptm Dems am 42) 
When / + 1> 0 we have to reverse the inequality signs in the above. 
For instance, on putting m+/ = 6, and accordingly assigning the 
following values to m and /: 


m 9 8 7 6 5 4 

I | -3 ~-2 -i1 0 1 2 
it may be seen that the best upper estimate is obtained with / =—1, 
and the best lower estimate with/ = 0, so that in this case 0-000686 = 
= R, S 0-000703. 


2°. THE GENERALIZED Caucny Test. On putting 4, = 0" and 
applying Tests, I, II (sec. 3), we get the following convergence test, 
which may be regarded as a generalization of the Cauchy-Hadamard 
test, 

Test C. If, for a fixed l and e< 1, 


lim > 0, 


nooo In+l 
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oo 
the series Y\ a, is convergent; whereas the series is divergent if, 
nah 
for a given | and e>1, 
n 


Os Tim < oo, 
Nn» oo + 
When / = 0, this test yields the familiar Cauchy—Hadamard test 
(Introduction, sec. 2). 
If the convergence of the series can be established with the aid 


of Test C, we have by (3.19), for any m+/> 0, 


gm o™ 

g a Rn = -——_"——- +. (3.29) 
(1-@) sup —— (1-9) inf =— 

k=m 441 k= m r+ 


Here, 9 <1 is an arbitrary number, for which lim (0"/a,,,)> 0. 
N—> 
If the sequence {4,(/) = "fan 4a} is monotonically increasing for 


k =m, we have 


m 
aor s = Rais mel : (3.30) 
(1-9) lim —— 7 
h—> 00 Ape 


Whereas, if the sequence {A,(/)} is monotonically decreasing for 
k = m, we have 


mn 
ae = Raw Ss —_—__ . (3.31) 
@ (l=) tim 
: h— co Any] 
EXAMPLE 10. 
x Je. eRe, (3.32) 


i 8n 

It is easily shown that estimate (3.31) can be applied to series 
(3.32) on condition that m+/ 2 3. 

On taking @ = x, we have 


xml amt 


ee SR ’ 
(i—x)™ imei TE Ly 


3°, Raape’s Test. A particular case of the general Test III 
(sec. 3) is 
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Test D. The series )\ a, is convergent if, for any integral 1 = 0, 


nel 
A iin ee itn ae (3.33) 
n-> 00 antl 
and is divergent if 
A) > 0. 
When / = 0, we get 
Raabe’s Test. The series }' a,, is convergent if 
n=l] 
{,_ &p 
lim n(1—“es2) >1, 
ey Rr co ay 
and is divergent if 
n ( * “as1) sl, 
ay 
for all n= ny say. 
EXAMPLE 11. 
= 1 
a, 3.34 
a n(n+ 1) (n+2) (3:34) 


The convergence of this series is readily established by applying 
Test D. We can also make use here of the estimates for the remainder 
term of sec. 4, corresponding to cases (3), (c) and (3), (d). 

On applying estimate (3), (c) (sec. 4) with m 2 9, and 1 = 2, we 
get 


(m—1)(m+3) gs Atos aie 
Qm—3) (n+ (mt+I+ 1) (m+l4D >! = Cae (m+D) * 


(3.35) 


On applying estimate (3), (d) (sec. 4) with m+/> 0, /= 1 and 
m> 41/(21—3), we have 


m= ms3) mad 
(2m = 3) (m+) (m+ 141) (mtl+2) ~ 4" © Qin +1) (m+2)" 


(3.36) 
On comparing inequalities (3.35) and (3.36), say with m+/ = 12, 
it is easily seen that 
0-00315 = Ry = 0-00337, 
he true value here being Ry, = 0-00320, 
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4°. Gauss’s Test. If lim a,,,/a, = 1, d’Alembert’s test gives 
R-- co 


no answer as regards the convergence of the series, as mentioned 
above. If the ratio a,,,/a, has the form 


One _ M+ pr) +9(n) 
a, n+ gn®14+4(n)’ 


where g(n) and w(n) have lower orders than n*~!, the convergence 
or divergence of the series may be established with the aid of the 
foliowing test. 


Gauss’s Test. The series }\ a, is convergent when q—p> 1, 
nel 
and divergent when q—p = 1. 


EXAMPLE 12. When x= 1, the Aypergeometric series (ref. 7): 


ep a(a+ BBE) x(a+ 1) @+28(8+ D(6+2) 
L.y L2~y+D 1.2.3.y(y + 1) (y+ 2) 


is convergent provided that 


+ +... 3.37) 


yoatép. 


Notice that, from a certain m onwards, series (3.37) is of constant 
sign for any real «, 8, y (it is assumed that none of the numbers «, 
B, y is negative). 

We have in the present case, say with / = 0, 


9-9-2 
A,(0) = Saas (y-—«—B) 
and 
AQ) = —(y-a—8) <0. 


On observing that, for alln > —y, the sequence {4,,(0)} will be mono 
tonically increasing or monotonically decreasing, and making use 
of (3.26) and (3.27), we get 


(m+ y)Man, Sp = _ 4m 
(m+y) (y-«—B)-—(—a@) (y-B) = ™ = y-a—B’ 
(m> —Y/), 
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where 
3 _ a(e+l)...2tm—lB(B+1)...G+m—) 
= miyytl)...qv+m—1) : 
5°, CaucHy’s INTEGRAL Test. Let the general term of the series 


> a, be monotonically decreasing with increasing n. Obviously, 
nel 

it is now possible to choose an infinite set of positive functions a(x), 
monotonically decreasing and continuous for x > 0, and such that 


a(n) = ap. 
Let a(x) be one of these functions. The series ¥ a,, is now converg- 
ent or divergent, according as the improper integral 
{ ” atx) dx, (3.38) 
a 


where « = 1, is convergent or divergent. 
This test follows as a particular case from general Tests I and II 
(sec. 3), if we put say 


+1 
bn = i a(x) dx and /=0. 
n 


EXAMPLE 13. We are given the series 


py — to =O): (3.39) 


We choose as a(x) the function 1/(x In'+° x) and put « = 2, so that 
oo Z oe : 
~ @ln?2? 


i 1 1 
I xin'tex GE oin?x 
the series is therefore convergent. 
EXAMPLE 14. We are given the series 
2. ninnininn® 
We choose a(x) = 1/(xIn x In In x) and put « = 3: 


(3.40) 


‘80 j r) 
I. xinxininx™ ~ BBInx) = =, 


so that the series is divergent. 


SERIES 101 


ExaMPLe 15, Given the series 


ya (3.41) 


n=y i 


we choose a(x) = I/x” and put « = 1. On recalling that 


we get: 


se dx | : for o>1, 
o-—1 
oo for osl. 


The series is thus convergent for o> 1 and divergent for o 3 1. 
Notice the following points: 

(1) In view of the fact that the choice of the function a(x) is to a 
large extent arbitrary, an infinite set of estimates can in general 
be quoted, corresponding to the test. 

(2) When the sequence {a,} is monotonic, estimates correspond- 
ing to Cauchy’s integral test can be used, independently of the 


particular test used to prove the convergence of the series ¥ a, 
n=l 
EXAMPLE 16. 


n 
i= (a> 1). 
nay @ 
Let a(x) = x/a*, say. The function a(x) is monotonically decreasing 
for x> I/loga. Therefore, on evaluating 
ak htt a~1 | a—Ina-1 


=o —m. oo 
An k : Bay tae alna ka in? a 


and making use of estimate (3.26), we have 


m(m In a+ 1) - 2 hy sett! 
am-ya—D(minat 1-24 a 


(m = 1). 
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6°. N. V. BuGazv’s THEOREM; VY. P. Ermakov’s Test. Let a(x) 
be the function introduced in the statement of Cauchy’s integral test, 
and 6(x) some positive differentiable function, increasing as x increases 


and such that lim 1/d(x) = 0. The following theorem can now be 
x—> oo 


obtained on the basis of Cauchy’s integral test. 
THEOREM 3 (N. V. Bugaev). If the function 6'(x) a[8(x)] is mono- 
tonic for sufficiently large x, the series } a, and 8'(n)a[6(n)] 
n=l 


n=1 
are simultaneously convergent or divergent. 


Thus any convergent test applied to the series } 6’(n)a[6(n)} 
ne] eo 
will at the same time yield a convergence test for the series )' a,. 
nel 
In particular, we have the following corollary of N. V. Bugaev’s 
Theorem. 
V. P. Ermaxov’s Test. If 
e™a(e™) ap 
m-—>co a(m) 
the series Y a,, is convergent; whereas if 
n= 
e™a(e™) 


m—peo a(m) 


the series is divergent. 
+1 
On putting say b, = 6'(x)a [6(x)] dx and using the general 
n 
tests of sec. 4, an infinite set of estimates can be obtained (for the 


remainder term of the series y a,), corresponding to different 
nel 
methods of choosing the functions 6(x). 


7°. LOBACHEvsKi!’s TEST. If the terms of the series 


¥, a(n) 


n=1 


are monotonically decreasing, then the series is convergent or divergent 
at the same time as the series 


DL Pm2-™, 


m=1 
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where D,, is given by 
A(Pm) S2-", a Pm+l) Ss 2-™. 
We can also define p,, from the equation 
APm) = 2-™, 


if the function a(x) is monotonic and defined for any value of x. 
EXAMPLE 17. 


The equation 


1/p, =2™ 
im 
gives us p,, = 2% ; we form the series 
D Pm2-™ = y 2 
m=l mat 
This is a convergent geometrical progression, so that the series 
Sod 


LF 


nel 


els 


s also convergent. 


6. The convergence of alternating series 


Given the alternating series (3.8), we form series (3.8*) from the 
absolute values of its terms. 

To-establish the absolute convergence of series (3.8), we can apply 
to the positive series (3.8*) all the tests described above for series 
of constant sign. As already mentioned, however, tests for the con- 
vergence of series (3.8*) may not be valid for series (3.8). 

Alternating numerical series. Alternating series are those, the terms 
of which are alternately positive and negative. The following holds 
for such series: 


THEOREM 4 (Leibniz). [f the terms of an alternating series > ay 
nel 
are monotonically decreasing in absolute value, 


[Ona |) = 1 ap | (x = 1, 2, 3, ...) 
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and the n-th term tends to zero, 
lim a, = 0, 


Nh—> co 
the series is convergent. 
Estimation of the remainder term of an alternating series is simple 
and effective. 
The remainder term of an alternating series that satisfies the con- 
ditions of Leibniz’s theorem, 


Ry = QngitGnget +--+ 
has the sign of its first term a,,, and is less than it in absolute value: 


I Ral = Gngit Gngat vee 


The criteria for convergence of Abel and Dirichlet are more general 
than Leibniz’s test. ‘ 
Suppose we have the series 


Py Onbn = byt ab, + ... +agbat ..-s (3.42) 


where {a,} and {b,} are sequences of real numbers. 
ABEL’s Test. Series (3.42) is convergent if the series 


YM by = byt byt... + Og t+... (3.43) 
n=l 
is convergent, while the numbers a, form a monotonic and bounded 


sequence: 
|@,|< K (n= 1, 2, 3,...). 


EXAMPLE 18. 
ad 1 1 1 I 
E(-#) = we ee ae 


DIRICHLET’S TEST. Series (3.42) is convergent if the partial sums 
of series (3-43) are bounded in aggregate: 


lmlsM  (n=1,2,3,..0, (3.44) 


while the numbers a, form a monotonic sequence tending to zero: 
lim a= 0. 
N=» oo 
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Assumption (3.44) is more general than the assumption of the 
convergence of series (3.43), so that Abel’s test is a consequence of 
Dirichlet’s test. 


7. Infinite products and their convergence 


Suppose we have a sequence of numbers (or functions) 


Pir Pas Par vee Pry vee (3.45) 
The symbol 
T] Pn = PuP2Ps---Pn--- (3.46) 
n=l 


s known as an infinite product. 
The product of a finite number of consecutive terms 


Py = py, Py = DiPo, Ps = PyPaPs, ---> Pn = PiPa-++Pn-iPn (3.47) 


is called a partial product. The sequence of partial products will be 
denoted by {P,}. 


EXAMPLE 19. 2 
a mat3) da 25 3.6 
UD aspera ey cee oer aa 


The convergence of infinite products. 
Four fundamental cases may be distinguished. 
(1) The sequence of partial products {P_,} has a finite limit different 
from 0: 
lim P, = P. (3.48) 


=> oo 


This limit is called the value of the product and is written as 


P=J] Py (3.49) 


i n+3 1 
n> oo 3 n+i a3. 
(2) The sequence {P,} tends either to + «, or to — ©, 
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EXAMPLE 20. 
J] » = 1.2.3...70...5 P,=nt; lim nt! = o, 
n=1 n—> oo 
(3) The sequence {P,} has the limit 0. 
EXAMPLE 21. 
1 : 
Pr= > for any 7, 1, Py = 3H lim ox = 0 


(4) The sequence {P,} has no limit (e.g. oscillates). 
EXAMPLE 22. 


— nn $3) 
IC” aanesd 


a 14/_2.5\3.6/ 4.7) 1p 2 
~~ 2.3\ 3.4/4.5) 5.6)°°°? 3 are Be 


In the last three cases the sequence is said to be divergent. Case 
(3) ( lim P, = 4 implies a different classification to that accepted 


n> co 
for infinite series. However, this is convenient for the statement of 


many theorems on infinite products. 
An infinite product can be written in the form 


TT pn = PmTms (3.50) 


n=l 
where 


Pm = PiPa+++Pm 
is the partial product of the first m terms, and 


Tm = PrsiPmso++>= I] Pn (3.51) 
n=mt+1 
is called the remainder product, this being analogous to the remainder 
term: of a series. 
THEOREM 5. If product (3.46) is convergent, the remainder product 
(3.51) is also convergent for any m (if all the p, # 0); the convergence 
of the remainder product implies the convergence of the original product. 
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Thus discarding a finite number of initial factors or combining 
at the start a finite number of factors has no effect on the convergence 
of an infinite product. 

If an infinite product is convergent, then 


lim z,, = 1. (3.52) 
m—> co 
This follows from (3.50); 
P 
km = Pp 
m 


and from the fact that P 0. 
If an infinite product is convergent, then 
lim p, = 1. (3.53) 


noo 


This follows from the chain of equations: 


In the case of a convergent product, p, > 0 as from a certain n. 
This follows from (3.53). In view of Theorem 5, we can assume with- 
out loss of generality that all the p, > 0. 

There is a connection between the convergence of infinite products 
and that of series. 

A necessary and sufficient condition for convergence of the infinite 
product (3.46) is that the series 


> In py (3.54) 
n=1 
be convergent. 
If S is the sum of series (3.54), we have 
P=eé, (3.55) 
On writing s, for the partial sum of series (3.54), we have 
Sp = In Py, Py = eo, (3.56) 
It follows from the continuity of the logarithmic and exponential 
functions that, when P,, tends to a finite positive limit P, the partial 


sum s,, tends to In P, and conversely, if the finite limit S exists, the 
limit for P is equal to e%, 
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The nth term of an infinite product may be conveniently written 
as 
Pa = lta, 


and product (3.46) written as 


Tl G+a,), (3.57) 


n=l 


while series (3.54) is written as 


> in(i+a,). (3.58) 
nel 
THEOREM 6. If, for sufficiently large n, all the a, > 0 (ora, <0), 
the necessary and sufficient condition for convergence of product 
(3.57) is that the series 
Ya. (3.59) 
n=. 
be convergent. 
A necessary condition for convergence of (3.57) and (3.58) is that 


lim a, = 0, whence lim Heist Ba 
N—> oo n—> co ay 


andy 


In the general case a, = 0, the infinite product (3.57) is convergent 
if the series 
¥ at. (3.60) 
n=] 
is convergent along with series (3.59). 
The product of Example 19 can be written as 


ce n(nt+3) hed 2 
Th aeness> 0 -arness): 


n=l 
Here 
_ —2 
m™ (2+ D@4+2) 
and 


lim a, = 0. 
N—> co 
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The following will make it clear why, in the case 
P=0, 


the infinite product is classified as divergent. 

The necessary and sufficient condition for the infinite product to have 
a zero value is that series (3.54) or (3.58) have the sum — -. 

This is the case for example when a, < 0 and series (3.59) is diver- 
gent, or, when series (3.59) is convergent, but series (3.60) is diver- 
gent. 

Product (3.46) is said to be absolutely convergent when series 
(3.54) of the logarithms of its factors is absolutely convergent. 

An absolutely convergent product has the commutative property. 
The necessary and sufficient condition for absolute convergence of 
product (3.57) is that series (3.59) be absolutely convergent. 

We have, for Example 19: 

2 1 1 


2 


lanl = GHGeD 7 GeDatD 


But }) 1/n? is a convergent series (see example 15), so that the 
n=1 
product is absolutely convergent. 


It may be remarked that the theory of functional products bears 
the same relationship to the theory of numerical products as the 
theory of functional series to that of numerical series. Let us give 
an example of a functional product. 

EXAMPLE 23. The product 


co x2 
xl l-iaa 


represents sin x for any x. 


8. Double series. Fundamental concepts and definitions 


In addition to ordinary (simple) infinite series, multiple series are 
employed in analysis and applied mathematics, e.g. double, triple, 
etc., series. We shall confine ourselves here to a brief outline of the 
theory of double series. 
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DEFINITION. A double series is defined by the symbol 


2 


YY on ( > “n); (3.61) 
h=o [=o k, l=0 i 
and is made up of the terms of the double sequence {a,,} (k = 0, 1, 
2,3, ...; = 0, 1, 2, 3, ...); corresponding to it, we have a double 
sequence {S,,,} of partial sums 


kem—1L l=n-1 
Smn = é %, Op). (3.62) 


If a finite limit exists on simultaneous and independent increase 
of the indices m and n, 


S= Lm Sm,= Yo ae, (3.63) 
N—> 00 kh, i=0 
M—> ce 


the limit is called the sum of the double series (3.61), and the series is 
said to be convergent in this case; otherwise it is divergent. 

If the terms a,, are summed consecutively, first over one index, 
then over the other, the double sum will be described as an iterated 
series, Obviously, the following two cases are possible here: 


y ( y “n) (3.64) 
leo \ ko 


> (5 ou): (3.65) 


Iterated series (3.64) is said to be convergent if the series 

A, = os Qn, (3.66) 
(for any fixed subscript /) and 
A, (3.67) 
1=0 


are convergent. 
Similarly, series (3.65) is said to be convergent if the series 


B, = 2» apy (3.68) 
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(with any fixed subscript &) and 


yr By (3.69) 


are convergent. 
Let us introduce the notation 


A= lim ( lim Sn) (3.70) 
Noo \MN—> 
Similarly, 
B= lim Basses Smn) + (3.71) 
mM— > po \n-> 


A series for which all the a,, = 0 is called a double series with 
positive terms. 


If the double series }' a, and } |a,,| are simultaneously 
k, [=o h, [=o 
convergent, the double series is said to be absolutely convergent. 


2 7 
Whereas if x a,, is convergent, one |a,,| is divergent, the 
k, [=o , To 


double series )’ a, is non-absolutely (or conditionally) conver- 
h, l=o 
gent. 


9, Some properties of double series 


I. If double series (3.61) and series (3.66), (3.67) are convergent, the 
iterated series (3.64) is also convergent and has the same as the double 
series. 

Similarly, the following property holds: 

Il. if double series (3.61) and series (3.68), (3.69) are convergent, 
iterated series (3.65) is also convergent, and has the same sum as the 
double series. 

Remark. Generally speaking, the convergence of series (3.66) and 
(3.68) does not follow from the convergence of double series (3.61) 

Tl. The necessary and sufficient condition for the convergence of 
the double series (3.61) with positive terms is that its partial sums be 
bounded. 

IV. Uf one of the three series (3.61), (3-64) and (3.65) with positive 
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terms is convergent, the other two are convergent and have the same 
sum. 

A one-to-one correspondence can be established between pairs 
of equal terms of the double sequence {a,,} and the ordinary sequence 
{b.}- We shall say for Sprevity in this case that the double series 


x @,, and the series 3 b, consist of the same terms. 
k, leo s=0 


V. If the double series  a,, and the series ¥ b, consist of 


h, =o BQ 
the same terms, the convergence of one implies the convergence of the 


other, and they have the same sum. 
VI. If the double series a |a,,| is convergent, the series y apy 
is convergent (but the eiverse dies not hold). a 
Vil. Uf the double series 5 @,, and the series ¥ b, consist 


kh, l=0 30 

of the same terms, the absolute convergence of one implies the absolute 
convergence of the other. Both series now have the same sum. 

VIII. The terms of an absolutely convergent series can be rearranged 
in any manner without changing the sum. 

The above properties can be useful in proving the convergence, 
and computing the sum of a double series. 

EXAMPLE 24. It is easily shown that the double series 


sa 1 
nro REDE G2) 


is convergent for «> 2 and divergent for a = 2. 
For, on putting k+/ = m, we find that m—1 terms of series (3.72) 
are equal to 1/m". Series (3.72) can therefore be written as the simple 


series 
2 m—) = 1 a | 

— = sna =: 3.73 
es m* eo me-t pe m ¢ ) 
Both the series on the right-hand side of (3.73) are convergent for 
a> 2 (Example 15), so that the series on the left-hand side is conver- 
gent. By Property V of double series, the double series (3.72) is also 
convergent, and its sum is equal to the sum of the simple series (3.73). 
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10. Some convergence tests for double series of positive terms. 
Estimates of remainder term 


A necessary condition for the convergence of any double series 


DY ayy is that 
k, [0 . 
lim ay, = 0, (3.74) 
ko 


1—> 09 


when k and 1 tend to infinity independently of each other. 

A Stricter necessary condition than (3.74) can be given for the con- 
vergence of double series with positive terms.’ 

For a double series with positive terms to be convergent, it is necessary 
that 


lim ¥ ay = 0 (3.75) 
k— co l=0 

and 
lim ¥ ay = 0, (3.76) 


loco k=O 


so that all the more, the following conditions must be satisfied: 


k 
lim ¥ ay = 0 (3.77) 
k— co lag 
and 
l 
lim Y ay = 0. (3.78) 
I> co k=Q 


From (3.77) and (3.78), we see that the following conditions must 
also be satisfied: 


lim ay; = 0, 
ko 

L— co 

lim a,,;= 0 for any J, (3.79) 
R—> 00 


lim a, = 0 for any k. 
1» 00 


As in the case of ordinary series with positive terms (see § 1, sec. 
3-5), comparison of the terms of two series leads to a number of gene- 
ral tests for the convergence of double series with positive terms, and 
corresponding remainder term estimates can be given. 
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Suppose we have the double series 


co 


by ap (3.80) 


R, l=0 


with positive terms, and some other series 


cy 


by. (3.81) 
k,i=0 


We assume that the convergence or the sum of the series (3.81) is 
known to us in advance. We introduce the notation: k+/ = n, 


im 2H = A, (3.82) 
open: Ott 

am by 

lim += 4. (3.83) 
n> co Ap) 


lim Pmt =A: (3.84) 
n—> co ARl 
The remainder term of double series (3.80) will be defined by 
Rim = mot lomtlmm (3.85) 
where 
hmoo, l=m—1 khmm—1i,l=oo 
mo = apy Fom = apy 
kam, leo k=o,l=m 
and 
'mm>= y Qh 
ki l=m 


We shall write B,,,, for expression (3.85), corresponding to the 
remainder term of series (3.81). 

Using the above notation, the following general sufficiency tests 
can be stated for the convergence of the double series (3.80): 

1°, 1f0 = Byy,y< + efor allm> N and A> 0, the series is convergent. 

2°. If — oo <B,,, = 0 for allm> N and A< 0, the series is converg- 
ent. 

3°. If, with finite A and A of the same sign, Bim = + c, the series 
is divergent. > 
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4. If 0O<Bam< + for all m>N, and the conditions 
—co <A < + cand A = + ~are satisfied, the series is convergent. 

5°. If — © < Bam < 0 form> N and the conditions — 0 < A<0 
and A = — ~ are satisfied, the series is convergent. 

When series (3.80) is convergent, the following estimates hold 
for the remainder term: 


Bum = = Bam 

ee ae Rm (3.86) 
wo Ons 3 On 
inf — sup — 

k+t=m 2p) k+l=m pj 


When A= +oor d= —ef(or d= 4+), 


(3.87) 


Further, on choosing the },, by different methods, we can obtain 
from the above general convergence tests various practical tests which 
are sufficient for the convergence of a double series with positive 
terms. Inequalities (3.86) and (3.87) enable us to give remainder term 
estimates corresponding to the convergence test chosen. 

We shall confine ourselves here to oneconcrete case, ¢.g. by putting 


bat = Onan, 141— F414, 1%, 41 + Cae (3.88) 
It now follows from the above general tests that the double series 


> ay is convergent if: 


a, T=0 
(1) lim app = 0; (3.89) 
p-reo 
(2) Paci 3, (3.90) 
7 RET Soo Fal 
and is divergent if: 
a= in O26. (3.91) 
k+l oo Api 


The remainder term estimate corresponding to this test has the 
form 
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amo t 2am — & Amo + 4pm — @ 
‘mo Om ; mm < Rinm < mo ‘om ; mm : GB 92) 

i * kl 

sup — inf = 

k+l=m Gp} k+l=m Ql 


where b,, is given by equation (3.88). 

Fulfilment of condition (3.90) only is not sufficient for convergence 
of the double series. 

EXAMPLE 25. The series 


s=,3,(2) (3): 


is obviously seen to be divergent; at the same time, the condition 
A = 01> 0 is satisfied although lim a,, = &. 


BP 
poo 
EXAMPLE 26. Let us take the double series 
ka 1 
= 2, Eee’ 
Condition (3.89) is satisfied here, since 


s (3.93) 


lim dp, = lim ee 0. 
poe PP peo [(PtI)IP 


We have by (3.90): 


lim on Tim | Zh de ta Fn, 41 — Sep t+ Sat 
R+lroo GRy — h+-1-r 00 Opt 
I+1 : 
Te2 for fixed /; 
(+1) 0+1) k+1 
= Sor > f fi dk; 
atin (E42) 042) ) kee “Or 


1, if simultaneously 
k and 1+, 
But obviously, + = +)D/d+2)s8 1 and 52 (k+1)/(K+2) = 1, 
ie. A = > for all k, 1 = 0. Series (3.93) is thus convergent. 


To estimate Ry», in accordance with (3.92), we first observe that, 
for the function F(x, y) = (x+1) (v+D/@+2) (y+2), necessary 
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conditions for an extremum: OF /0x = OF/dy = 0, are not satisfied 
for any finite positive x and y, ie. the greatest and least values 
of the function can only be attained on the boundary of the domain 
MBX, p<. 
Jt may easily be shown by using this fact that 
: by ~- (K+1I)U+1) m+1 1 
inf == inf ——W 2 =. 
Rtlem4y  rtl=m(K+2)0+2) m+2 2 
and 
(k+1)¢+1) 
sup =~ = 1. 
neiem &+2) (42) 


On substituting the values obtained in inequality (3.92), we get 


2 1 4(m +2) 2(m +2) 


G+Dt m+ DF = Rann a+ mt)! M+ Di+ DF 


For instance, we obtain with m = 4: 
0-0159 = Ram = 0-0382. 


§ 2. Series of functions 


1. Fundamental properties and convergence tests 


We shall discuss functional series in this article, i.e. series whose 
terms are functions. We shall confine ourselves simplicity to the series 


(2) +12) + os Hig oe = Dy u(x), 3.94) 


the terms of which are functions of a single variable. Immediate 


generalization is possible to the case of two or more variables. 
DEFINITION. The expression (3.94) is called a functional series; 
it is formed from the terms of the function sequence {u,(x)}, defined 
on the set X = {x} of the numerical axis E,, and has a corresponding 
sequence {s,}: 
n 
5, = > u(x) 
RE1 
of partial sums. 
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There are different types of convergence for the function s,(x): 
uniform, non-uniform, in the mean, etc. Corresponding to these we 
have different forms of convergence of the functional series. 

Let the sequence {s,(x)} be uniformly (non-uniformly) convergent 
on X to the function S(x). Series (3.94) is then said to be uniformly 
(non-uniformly) convergent, and S(x) is its sum: 


S(x) = ze Up (x). (3.95) 
n= 
A Condition for Uniform Convergence of a Series: The necessary 
and sufficient condition’ for series (3:94) to be uniformly convergent 
on X is that, given any >, there exists an N independent of x such 
that, given any n>N and any m = 1, 2, 3,..., the inequality 


Sy anl2) 


kent. 


<E 


holds for ail x € X. 
Tf all the terms of series (3.94), uniformly convergent on the set X, 
are multiplied by the same function v(x), bounded on X, 


|¥(x)| = M, 
the uniform convergence is preserved. 
Tests for uniform convergence of series. 


1°. WEIERSTRASS’S Test. [f the terms of series (3.94) satisfy on the 
set X the inequalities 


| t,(X)| SS Cp (2 = 1, 2, 3, ...), (3.96) 


where c, are the terms of a convergent numerical series, (3.94) is uni- 
formly convergent on X. 
When (3.96) holds, the series 


2 
> ¢n 
n=1 


is described as majorant for series (3.94). A functional series satisfying 
Weierstrass’s test is absolutely convergent, and moreover, the series 


Eb) 


is uniformly convergent. 
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Cases are possible when series (3.94) is uniformly but not absolutely 
convergent. 
The following tests hold for functional series of the form 


oo 


ae Qy(X)b, (x) = ay(x)Oy(x) +... Hag(Xbn(x)+.... (3.97) 
n= 

2°. ABEL’s Test. Series (3.97) is uniformly convergent on a set X 
if the series 


> a(x) = By(x)+O,(2) +... (3.98) 


is uniformly convergent on the set X, while the functions a,{x) form 
a monotonic sequence for any x, and are bounded for any x and n: 


la@,(x)| = K. 


3°. DiricHwet’s Test. Series (3.97) is uniformly convergent on 
the set X if the partial sums s,(x) of series (3-98) are bounded for 
all x and n: 
Isn()| SM, 


while the functions a,(x) form, for any x, a monotonic sequence, uni- 
formly convergent to zero on the set X. 

Let us also note some properties of the sum of a functional series. 
If the functions u,(x) of series (3.94) are defined in the interval 
X = (a, 5) and are all continuous at the point x = x, of this interval, 
and in addition, series (3.94) is uniformly convergent, the sum S(x) 
of the series is also continuous at. the point x = X 9. 

The following proposition is a consequence of this: if the functions 
u,(x) are continuous throughout the interval ¥ = (a, 5) and if the 
series is uniformly convergent there, the sum S(x) of the series is 
continuous throughout the interval. The uniform convergence in 
these propositions is a sufficient but not a necessary condition, since 
there are series, non-uniformly convergent in an interval, having a 
sum continuous in the interval, We shall not state here necessary 
and sufficient conditions for continuity of the sum of a series, and 
shall only mention that uniform convergence is necessary and suffi- 
icent provided the terms of the series are in addition positive in the 
interval. 
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Term by term integration of series, If the terms u,(x) of series 
(3-94) are continuous in the interval X = (a, b) and the series is 
uniformly convergent in this interval, the integral of the sum S(x) of 
the series is equal to the sum of the integrals of the terms: 


| ” sop de = F (* wtadax. (3.99) 
a n=l Ja 


In other words, term by term integration of the series is permissible 
under these conditions. 

The following is a generalization of the above theorem: if the 
terms u,(x) of the series are integrable (in Riemann’s sense) in the 
interval X = (a, b) while the series is uniformly convergent, the sum 
S(x) of the series will also be integrable and (3.99) will hold. 

Term by term differentiation of series. If the terms u,(x) of series 
(3.84) are defined in an interval ¥ = (a, b) and have continuous 
derivatives uj(x) in X, and series (3.94) is convergent in X, while 
in addition the series formed from the derivatives 


= U(x) = fay(x) + u(x) + .+. tut ..-s 


is uniformly convergent, the sum S(x) of series (3.94) has a derivative 
in X, and 

S@= F ur), (3.100) 

nel 

in other words, the derivative of the sum is equal to the sum of the 
series formed from the derivatives, i.e. term by term differentiation 
of series (3.94) is permissible. It may be mentioned that the restric- 
tions of this theorem can be somewhat relaxed (see ref. 11, vol. II, 


§ 407). 


2. Power series 


This branch of the theory of functional series is particularly import- 
ant. 
A series of the form 


DY a(x— Xp)" = Ay baylx—Xp)-+ .6- A(X —X)*+~--- (3.101) 


n=O 
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is called a power series. On substituting x, = x—xX, (we shall omit 
the subscript 1), it reduces to the form 


YD ayx™ = do taxtagx? +... +a,x™+..., (3.102) 
n=0 
with which we shall be concerned in what follows. 

There are three possible cases. 

Case 1. Series (3.102) is convergent for any real x, i.e. throughout 
the axis £,. In this case the series is said to be convergent everywhere. 

Case 2. Series (3.102) is convergent only for x = 0, The series is 
now said to be divergent everywhere. 

Case 3. The series is convergent in some interval (—R, +R), 
0<R< +o; the number R is called the radius of convergence of 
the series. 

We shall accept the convention that Case | corresponds to a radius 
of convergence R = oo, and Case 2 to a radius of convergence R = 0. 

EXaMPLeé 27. The series 


is convergent for any x (R= ~). 
EXAMPLE 28. The series 


Yi atx? = x+2bx?43lxFt ... 
n=1 


is convergent only for x = 0 (R = 0). 
EXAMPLE 29. The series 


yx = L+xtx+... 


n=l 


is convergent in the interval (-1, +1) (R= 1). 
EXAMPLE 30. The series 


ae Perea x 
eg Org ge 


is convergent in the semi-interval (—1, +1) (R = 1). 
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EXAMPLE 31. The series 


Pr ar a a 
is convergent in the segment [—1, +1] (R = 1). 
If the limit 
a 
lim || = 9, 
n—aoo| dn : 


exists, (see d’Alembert’s convergence test) then 


1 
R= a (3.103) 
(R=  forg@=0, R= 0 for 9@= ~). 
On starting from Cauchy’s test, we get 
Peas, (3.104) 
elim Yia,) 


Tf series (3.102) has a radius of convergence R > 0, no matter what 
the positive number r< R, series (3.102) is convergent uniformly 
with respect to x in the segment [—r, r]. 

The sum S(x) of series (3.102) is a continuous function of x for 
all x between — Rand R. 

THEOREM 7 (on the identity of power series). Jf two power series 


¥ a,x" and 5 b,x" 
n=0 n=0 


have the same sum in the neighbourhood of the point x = 0, the series 
are identical, i.e. their corresponding coefficients are equal: a, = b,. 

The following propositions concern the behaviour of a power series 
at the ends of the interval of convergence. If power series (3.102) 
is divergent at an end of the interval of convergence, the convergence 
cannot be uniform in the semi-interval (0, R). 
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The converse is: if the power series (3.102) is convergent for x=R 
(x =— R) (even non-absolutely,) the series is uniformly convergent 
throughout the segment {0, R] ( [—R, 0]). 

THEOREM 8 (Abel). Jf series (3.102) is convergent for x = R, its 
sum remains continuous (from the left) for this value of x, i.e. 


lim S(x) = S(R). 
x—»>R-0 


See Example 30 forx = —R = —landExample3i forx = —R= 
=-I,x=R=1. 


3. Operations on power series. Taylor series. Integration and 
differentiation of power series 


(a) Power series (3.102) can be integrated term by term in the 
segment (0, x], where |x| < R: 
x oo x eo xatl 
S(xjdx= Y | ayx"dx = Y a,——; (3.105) 
0 n=0 J 9 n=o n+l 
x may reach the end of the segment at which series (3.102) is con- 
vergent. 
(b) Power series (3.102 ) can be differentiated term by term as many 
times as desired inside its segment of convergence: 


oo 


Sx) = Yo na,x™, 


n=l 


S"(x) = 2: n(n — l)ayx"-?, 


n= 


SM(x) = 5 n(n—1)...(n— m+ lagx™-™; 
n=m 


this also holds for an end point of the segment at which the series is 
convergent, 

Taylor series. Different forms of the remainder term. A function 
expressible as a power series in its interval of convergence has deriv- 
atives of all orders inside the interval. The series itself is the Taylor 
series of the function. 
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If the function is expanded as a Taylor series in the neighbourhood 
of the point Xp, 


f= 2, p(x — Xo)" (3.106) 
ne 
in this neighbourhood, where 


oo af “en (0! = 1). (3.107) 


The particular case of a Taylor series when x9 = 0 is sometimes 
called a Maclaurin series. As follows from (3.106) and (3-107), it has 
the form 


fla) = Sana (3.108) 


where 


Z fF) 


- n! 


On confining ourselves to a finite number of terms in a Taylor 
series, a function f(x) can be written as a partial sum s,, of the series 
plus a remainder term r,: 


n Co 
SX) = Y) alx—xo)P+ YL an(x—%o) = So(x)+ra(x). (3.109) 
kheo kenti 
When x + Xo, the remainder term r,(x) is an infinitesimal of order 
higher than (compared with x—x,). There are various familiar 
forms of the remainder term of a Taylor series. 
The form of Schiémitch and Roche: 


(n+1) = . 
Se + = xo} Hie: = Xo) (y_gyrti~r(e—x,)"+1, (3.110) 
Here p>0, O< 6<1 

On assigning concrete values to », we get more specialized forms 
of the remainder term: 

Lagrange’s form (p = n+1): 


r, n(X) = 


(n+1) = 
P(X) = CON (x—x,)"? (<6<1). 111) 
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Cauchy's form (p = 1): 


Lira Trot He xl) 6" (x—x,)"*? O=<6<1). 
(3.112) 


In spite of the indeterminate size of 0, these forms of the remainder 
term enable us to estimate the accuracy of replacing f(x) by the mth 
degree polynomial s,(x). If the (n-+1)th derivative is bounded in 
absolute value in the interval between x and x, by the number M, 
we have from (3.111): 


T,(x) = 


M\x- Xo [eta 
(n+)! 
EXAMPLE 32. The Taylor expansion of the function f(x) = e* in 
the neighbourhood of the point xy = 0 is 


Ira) | 


x xt x” 
r= lt+sptayp+ eee tay tra), 


where 
1 antl xnt2 
WO) = Gait tart 
By (3.111): 
ee 
Se GEpt | 


Here (when x>0): 
ntl 
|rn(x) | < e* Gant’ 


For instance, when x = 1: 
3 
ral) | < Cea 


The remainder term can also be expressed in the integral form, 
which contains no indeterminate numbers: 


r(x) = = i} * fO+E) Oe — 1" dt. (3.113) 
x 
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We can write, in the above example: 
j ‘x 
nO == i e(x— ty dt, 
ni 0 


Notice that a Taylor series may be convergent, and not represent 
its generating function f(x). 

EXAMPLE 33 (Cauchy). Let y(x) be a given function, expressible 
in the neighbourhood of x = 0 by the series 


p(x) = (0) +20 +20 24 ee (3.114) 


We add to it the function p(x) = e7!". If we complete the 
definition of p(x) by putting y(0) = 0, both p(0) and all its derivatives 
wy (0) vanish, so that the Taylor expansion of p(x) in the neigh- 
bourhood of x = 0 is identically zero. But now: 


fo) = 2) +9) = FEO eA sey. GUS) 


It is clear from this that equality of the expansions of the functions 
(3.114) and (3.115) does not allow us to deduce the equality of the 
left-hand sides: f(x) # (x). 

In general, if two functions f(x) and g(x) are equal at x = xy 
and all their derivatives are equal, while at the same time the functions 
are not identically equal, their Taylor expansions are nevertheless 
the same in the neighbourhood of x = x. 

Various operations on power series. Substitution of a series into a 
series. Suppose we have the series 


Z=fQ) = Qtaytayrt ...= yw (3.116) 


convergent in the interval (—R, R). The variable y is expressible in 
turn as a power series in x: 


y= Ax)=botbxtbxX+...= FY bx", (3.117) 
nao 


convergent in the interval (—r, r). Say we want to express z as a 
power series in x and to find the interval of convergence of the series. 
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On formally substituting series (3.117) into series (3.116), we get 


z= ¥ A,X, (3.118) 
n=0 
where 
Ag = A +aybotabi+..., 
Ay = aby + 2aghob, + 3032, + ..., 
Ay = 


Oyby + a9(B3 + 2byby) + 2a4(bob} +2) +... 


The question of the convergence of series (3-118) is answered by 
THEOREM 9. 1°. If 
[do | > R, 


Series (3.118) is divergent, whereas, if 
|8g| < R, 
the series is convergent in the interval (— R,, Ry), where 


R= (R= |b De 


= ; 3.119 
M+R-|b | ( ) 


@ being an arbitrary positive number that satisfies the condition o<r 
and can be taken as close as desired to r, while M is the least upper 
bound of thenumbers \b,,|0™ (m = 1, 2, 3, ...), so that |b,,| 0" 3 M 
or all m, 

2°, If by = 0, series (3.118) will be convergent in an interval (—R,, 
R,), where 
_ 
~ M+R° 


3°. If the series z = ¥. a,y" is convergent for all y, i.e. in the interval 
(— -, + ©), series (3.118) will be convergent for |x| <r, i.e. in the 
interval (—r, r). 

Multiplication and division of power series. 

THEOREM 10. The product of the series 


Ry 


f(x) = Dx a,x" and (x)= = bnx", 
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convergent respectively in the intervals 
,=(-~-R, Ry) and k= (—Re, Ry); 
is given by the equation 
FOX) = f(X)P(x) = cgotex+eax*+...= y Cnx” 


nm=d 
where Cy = agbo, C, = Apbyt+aybo, Cy = Apbot+a,by+agbo, etc., 
and is convergent in the smaller of the intervals I,, Ip. 
The quotient of the division of 1 by the power series 1+ }) b,x": 
n=l 
ste 
1+ 3 b,x* 


nel 


fx) = 


convergent in an interval (—r, r), is given by the series 
fo) = 14Ayxt Aptt oo = 14 F Age, (3.120) 
n= 


where 4, = —b,, A, = b?—b,, Ay; = —b8+2b,b,—by, ete. 
THEOREM 11. Series (3.120) is convergent in the interval (—o/ {M+ 1], 
o/[M+1), where 0 < 9 <r and @ can be taken as close as desired 
to r, while M is the least upper bound of the numbers | b,,|o"(m = 1, 
2, 3, ...). 
We can easily pass from this to the division of one power series by 
another: 
~ n 
p(x) = Ay t+ax+anrx?+ ... = Ph 
yx) by FOX + gx? +... > bax” 


nao 
We have 
1 
a = Gq Go tak tae? + oe J) FA + Ag? + ...), 
where 


14 F Ag = —- 
a 14—-¥ b,x" 
bo 1 
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is obtained as indicated above. The expansion 


is now convergent in an interval determined by the above theorems. 


4. Complex series 


A numerical (or functional) complex series 


¥ cp (3.121) 


n=l 


is one in which the terms are complex numbers (or functions): 
Cn = Gn tiby. (3.122) 


The convergence of complex series (3.121) to the sum S = 4+iB 
is equivalent to the convergence of two real series 


y (3.123) 
nel 
> Das (3.124) 
n=1 
to the sums A and B respectively. 


We have: 
THEOREM 12. If the positive series 


= ie,| = oy Vath, (3.125) 


composed of the moduli of the terms of series (3.121), is convergent, 
series (3.121) is also convergent. 

In this case series (3.121) is said to be absolutely convergent. D’ Alem- 
bert’s and Cauchy’s tests retain their validity for complex series. 
The theorem on rearrangement of the terms of a series and the rule 
for term by term multiplication of series can be carried over of abso- 
lutely convergent complex series. All the theorems on absolutely 
convergent real series retain their validity for absolutely convergent 
complex series. 
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Functions of a complex variable. If, for every value of a complex 
variable z from a domain Z in the complex plane, there is a corres- 
ponding single value of another complex variable w=w- iv, wis called 
a complex function of z in the domain Z and we write 


w= f(z). (3.126) 


If the function f(z) is expressible by a Taylor series in the neighbour- 
hood of the point Zp, ic. can be expanded as a convergent power 
series in powers of (z—zp), it is called an analytic function of z at the 
point zo. If f(z) is expressible as a power series in the neighbourhood 
of any point of the domain Z (open or closed), it is said to be an 
analytic function of z in the domain Z. Functions having this property 
are of the greatest interest in applied mathematics. 
The complex power series 


¥. en(z— 2)" (3.127) 
n=0 
has a number of properties similar to those of real power series. 
We can consider in future, without loss of generality, the series 


Y en2”. (3.128) 
n=0 

Since this series has a circle of convergence instead of an interval 
of convergence, the term radius of convergence acquires a strict mean- 
ing here. 

If the coefficients c, of power series (3.127) are real numbers, the 
radius R of the circle of convergence coincides with the previous 
radius of convergence. 

The foliowing proposition holds: if the series (3.128) is convergent 
at some point z, of the circumference |z|=R, then as the point z 
approaches the point 2, from inside the circle along a radius, we have 


lim SY gz" = ¥ enzh. 
zi—> Zo n=O n=0 : 
A complex power series can be differentiated term by term inside 
its circle of convergence. 
If a function is expanded, as a series in powers of z, the distance 
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from the origin (z = 0) to the nearest singulart point of the function 
is equal to the radius of convergence of the sum of the series. 


EXAMPLE 34. 
Ly _2a 74 78 — pyng2n = (pyre 
Tez! 22+ 24-784 .., +(—1)"2' apegnn ay 1)*z2", 
(3.129) 
If we take the real axis z = x, the expansion 
ae 24 x4 6 
aa KPAX HOPE LL, (3.130) 


has a radius of convergence R = 1, although the function 1/(1+.x?) 
and its derivatives have no discontinuities on passing through the 
points +1. On returning to expansion (3.129) in the complex plane, 
we see that the function 1/(1+z*) has discontinuities at the points 
+i. This is in fact the reason for the divergence of expansion (3.130) 
for |x}> 1. 

If we introduce the notation c, = a,+ib,, (a,, 6, are real numbers), 
|z| =7r, arg z = 9, series (3.128) can be written in the form: 


oo oo ; 
¥ caz® = Vi (a, +ib,)rrei™® = 
n=0 n=0 


= ¥ r(a,+ib,)(cos nO +i sin nO) = 


n=0 


= y r™(a,, cos nO ~ b, sin nO) +i y r(b, cos nO + a,, sin nO). 


nO n=O 
Further, we have, on writing a,r" = A,, —d,r" = B,: 
Y oz" = Vi (A, cos nO + B,sinnf)+i ¥ (—B,cosnd + A, sind). 
n=0 nad nxd 


The real and imaginary parts of the series are thus written as trigono- 
metric series. 


TA singular point is one in the neighbourhood of which a function is not 
expressible as a power series. 


132 MATHEMATICAL ANALYSIS 


EXAMPLE 35, 


= yan (r=|z|< 1); 


i 1 _ _l-rcosé 4 
J—z 1—(rcosé+irsin6) 1—2rcos@+r? 


. _rsing aS Soke 
ope eR TN Senne ss Ie sin k6, 


from which it follows that 


1—rcos@ aan 

laneeere eo oe 
rsin®@ ree 

I—2rcosO+r2 nang sin k6. 


5. Trigonometric Fourier series 


A function f(x) having a period 2nt (f(x)=f(x+2an), n= +1, +2...) 
can be expressed, under certain restrictions to be described below, 
as an infinite trigonometric Fourier series 


i@)~ 2 + ¥ (@, cos nx-+b, sin nx). (3.131) 
ne=1 


The Euler—Fourier formulae are used to find the coefficients of 
series (3.131): . 


a, = = F(x) cos nx dx (n = 0, 1,-2, ...), 
1 rd 
b=—[ fo)sinmedy (w= 1, 2,3... 


(3.132) 


In order that the Fourier series (3.131) be convergent to the given 
function f(x), ic. for its sum to be equal, at every point x, of the 
interval (0, 27), to the value f(x) at this point, the function f(x) 
must satisfy certain conditions (see below, and Chapter IV, § 2, sec. 5). 


+ If the period of f(x) is equal to 2, it can be transformed to the period 2x 
by bringing in the variable y=2x/L, so that all subsequent discussions retain 
their generality 
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THEOREM 13 (Localization theorem). The behaviour (i.e. converg- 
ence or divergence) of the Fourier series of the function f(x) at some 
point X_ depends exclusively on the values taken by the function in the 
immediate vicinity of the point x9. 

The sum Sp of the series (3.131) for f(x) at xo is determined as 
follows: 

(a) when f(x) is continuous at x», we have 


Sy = AX); 


(b) when f(x) has a discontinuity of the first kind at x, (so that 
the limits f(x)+0) and /(xp—0) exist), we have 


5, L404 fl%0-0) 
a are, ao 


We say that f(x) is smooth in the segment [a, 5] if it has a conti- 
nuous derivative in this segment. 

A continuous function f(x) is described as piecewise smooth in 
the segment [a, 5] if the segment can be split into a finite number 
of subsegments, on each of which f(x) is smooth. 

A discontinuous f(x) is described as piecewise smooth on the seg- 
ment fa, 5] if: (1) it has only points of discontinuity of the first kind 
(and only a finite number of these) on the segment, (2) on each of the 
subsegments (a, 8] into which the original segment is split by the 
points of discontinuity, the continuous function 


f@+0) for x=a, 
a(x) = 4 fix) for a=x~<, 
S@-9 for x= 8 
is piecewise smooth. 

A convergence test for Fourier series. The Fourier series of a piece- 
wise smooth (continuous or discontinuous) function f(x) of period 2x 
is convergent for all values of x9, its sum being equal to Sy. 

If a piecewise smooth function f(x) is continuous everywhere, its 
Fourier series is absolutely and uniformly convergent. 

THEOREM 14, Let f(x) be an absolutely integrable function of period 
2x, continuous and possessing an absolutely integrable derivative in 
some segment [a, b] (the derivative may cease to exist at individual 
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points). The Fourier series is then uniformly convergent to f(x) in 
every segment [a+6, b—6] (6>0). 

This theorem holds, in particular, for an absolutely integrable 
Ff) of period 2x, continuous and piecewise smooth on the segment 
{a, 6). 


EXAMPLE 36. The function f(x) = —In|2 sin x , Which becomes 


infinite for x =2ka (k = 0, +1, +2, ...), has period 2x. Its Fourier 
series is 
cos 2x cos 3x 


—~In 5] ar oe 


5 
2sin= = cosx+ 


THE DIRICHLET—JORDAN TEST. The Fourier series of a function 
J(x) is convergent at X9 to the sum S, if the function is of bounded 
variation in some segment [xy—46, Xo+ 4]. 

A more specialized statement is: 

DIRICHLET’s Test. If f(x) of period 2x is piecewise monotonic 
on a segment [—x, 2] and has a finite number of discontinuities there, 
then its Fourier series is convergent to the sum f(xX9) at every point 


of continuity and to the sum Sy =5 Lf(xo+0)+f(xp—0)] at every 


point of discontinuity (see Chapter IV, § 2, sec. 5). 
Dint’s Test. The Fourier series of a function f(x) is convergent at 
@ point Xp to the sum Sp if, given some h> 0, the integral 


(i eA)! 
t 


0 
exists, where 


9(t) = fot O+fxo-1)— 2So. 
The following is a particular case of Dini’s test: 
Liescuitz’s Test. The Fourier series of a function f(x) is conver- 
gent at a point x, which it is continuous to the sum Sy = f(Xo) if, 
given sufficiently small t> 0, 


[fott)—f@%o)| = Lta, 


where L and & are positive constants (« = 1). 
In particular, piecewise differentiable functions are suited to this 
test. 
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The Dini and Dirichlet-Jordan tests are not consequences of one 
another. : 

In the case of a function f(x), only specified on the semi-interval 
(—z, =), or defined outside it but non-periodic, application of the 
above theory is made possible by replacing f(x) by an auxiliary func- 
tion f*(x), having the following properties: 

f*@) = f), (-n<xs7n), 
f*(—7) = f*), 
while f*(x) is extended to the remaining real values of x in accordance 
with the law of periodicity. 

All the above theorems and propositions are applicable to the 
function f*(x). The series represents the function f(x) inside the inter- 
val. 

This construction is not required if f(—7) = f(x). In this case 
the Fourier series is convergent to f(x) throughout the open interval 
(excluding the ends), But outside the interval, the sum of the series 
in general no longer coincides with f(x), assuming the latter is defined 
throughout the real axis. 

On bearing in mind the footnote at the start of the present section, 
we can say that a function specified in any manner in any interval 
can be expanded as a trigonometric series in a very wide class of cases 
(this includes piecewise differentiable and piecewise monotonic 
functions) (see also Chapter IV, § 2, sec. 5). 

Expansions in sines only or cosines only. The Fourier series of an 
even function /(x)=(f(—x)) contains cosines only: 


Io) ~ 30 3 Gn, COS NX. 
2 nat 


The Fourier series of an odd function (f(x) = —f(—x)) contains 
sines only: 


Sf) ~ 2 6, sin nx. 


Every function /(x), specified in the segment [—z, 2], can be written 
as the sum of an even function f,(x) and an odd function f(x): 


f(x) = fi) +O), 
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where the component functions are 


A(x) =f +he fx) _fO-f-») 


pees, cand 

If a function is only specified in the segment [0, 2], we can define 
it arbitrarily in the interval [-z, 0] and thus obtain different Fourier 
series, which will have a sum Sy at a point x, between 0 and z, the sum 


being convergent either to f(x9) or to 5 [M%o+0) +f(x9—9)] (in the 


case of a discontinuity). 

If we complete the definition of the function in (—z, 0) as an even 
function, ie. put f(—x) = f(x), we get an expansion in cosines only; 
and if we complete it as an odd function (f(—x) = —/f(x)), we get 
ai expansion in sines only. 

EXAMPLE 37. f(x) = xOS x52). 

() Let f(x) = f(—x) = —x(-—xs x< 0); then 


ax 4 cos3x cos 5x 
fia) = 5-5 (cos St on), 


(2) Let f(x) = —f(—x) = x (-x< x < 0); then 


sinx sin2x sin3x 
fle) = (ea .). 


The order of the Fourier coefficients. If a periodic function f(x) has 
a finite number of discontinuities of the first kind (in a period), 
its Fourier coefficients will be infinitesimals of the form O(1/n) as 
n> e (see Chapter 1, § 3, sec. 8 and 15). 

This means that 


nla,|~< M, n|b,|< M, 


where M is a constant positive number independent of n. 

If the periodic function f(x) is continuous everywhere, its Fourier 
coefficients will be infinitesimals of higher order than 1/n asn + ©, 
ie. of the form o(1/n) (see Chapter I, § 3, sec. 8 and 15). 

This means that 


lim na, = lim nb, = 0. 
N—> co n> 00 
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If a periodic continuous function has continuous derivatives every- 
where up to and including the (m— 1)th order, its Fourier coefficients 
a, and b, will be of higher order than 1/n™ as n ~ =, i.e. 

lim n™a, = lim n™b, = 0. 
N—> vo N-> co 

In particular, if a periodic function f(x) has continuous derivatives 
of any order everywhere, its Fourier coefficients a, and 0, satisfy 
the condition 

n™a, +0, n™b, +0 
as n— oo, independently of m. 

Integration of Fourier series. Let us first consider a continuous 
function f(x), specified everywhere on £,. 

THEOREM 15. Jf an absolutely integrable function f(x) is specified 
by its Fourier series: 


fx) ~ 2 +e (ap, COS nx +b, sin nx), (3.133) 


b : 

we can find } S(x) dx by term by term integration of series (3.133), 
a 

independently of whether the latter is convergent or not, i.e. 


a,(sin nb— sin na) — b,(cos nb—cos na) 
= é 


> = 
| fodx = 2(b-a)+ ¥ 
F 2 hs 
(3.134) 

THEOREM 16. Let an absolutely integrable function be specified 


by its Fourier series (3.133) (convergent or not). The following 
Fourier expansion now holds for its integral: 


id 2 b 2 —b, cos nx +(a, +(— 1)**1aQ) sin nx 
ax = an Ea acatrhas SETA ah Re PA cape 
i fo)ax = F ony F : 
(-m<x<2). (3.135) 


A particular case of this theorem is when a) = 0 (the other condi- 
tions are retained); we now have for all x: 


[iseoax 2 > by s iy — bp COS NX + ay sin nx . 3.136) 
3 = 


14 ne n 
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Differentiation of Fourier series. 


THEOREM 17. Let f(x) be a continuous function of period 2x, possess- 
ing an absolutely integrable derivative (which may not exist at a finite 
number of points). The Fourier series for f'(x) can now be obtained 
Srom the Fourier series (3.133) for f(x) by term by term differentiation: 


St’) ~ ¥ nlb, cos nx —a,, sin nx). (3.137) 
ned 
THEOREM 18. Let f(x) be a continuous function of period 2n, possess- 
ing m derivatives, the first m—1 derivatives being continuous, and 
the m-th absolutely integrable (the m-th m-ay cease to exist at a finite 
number of points). Now: (1) The Fourier series of all m derivatives 
can be obtained by term by term differentiation of the Fourier series 
for f(x), all these series, except possibly the last, being convergent 
to the corresponding derivative; (2) the following relationships hold 
for the Fourier coefficients of f(x) (see above): 
lim n™a, = lim n™b, = 0. (3.138) 
N—> co Nr oo 
The series for f(x) and all the series obtained from it by term by 
term differentiation (except possibly the last) are uniformly convergent 
in this case. ; 
This theorem has the following converse. 
THEOREM 19. Given the trigonometric series 


ey ¥ (a, cos nx-+b,, sin nx), (3.139) 
n=l 


if the following relationships hold for the coefficients a, and b,, 
jn™a,| 2 M, |[n™b,| = M(m = 2, M = const), 


then the sum of the series is a continuous function of period 2x, pos- 
sessing m — 2 continuous derivatives, which may be obtained by term 
by term differentiation. 

THEOREM 20. Let f(x) be a continuous function specwied on the 
segment [—<, 2] and having an absolutely integrable derivative (which 
may cease.to exist at a finite number of points). Then 


T'@o~ 5 + > [(b, +(— 1)"c)} cos mx — na, sin nx], (3.140) 
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where a, and b, are the Fourier coefficients of f(x), while the constant 
c is given by the equation 


1 
c= —{f@)—f(—m). 3.141) 
THEOREM 21. Given the series 
2+ ¥. (aq cos nx +B, sin nx), (3.142) 
n=l 


if the series 
+ + y [(2b, + (— 1)"e) cos nx — na, sin nx}, (3.143) 
n=1 


where 
e= lim ((—1)"*1nd,], (3.144) 


R—> co 


is the Fourier series of an absolutely integrable function o(x)t, 
x 

then the series (3.142) is the Fourier series of f(x) -| g(x) dx + 
2 0 

+5 40+ Y a,, continuous for —%<x< 2, and is convergent 
nel] 

to this function, while obviously f’(x) = (x) at all the points of 

continuity of ¢(x). 

THEOREM 22. Given the series 


o+¥ (~ 1)" (a, cos nx +b, sin nx), (3.145) 


where a, and b,, are positive, if na,, nb, do not increase (as froma 
certain n} and tend to zero asn— , the series is convergent for 
—n< x <2 and has a differentiable sum f(x), where 


fio = oy (— "nb, cos nx— a, sin nx), 


ie. series (3.145) can be differentiated term by term. 

Similar theorems can be stated for functions specified on the seg- 
ment [0, 7] (see for example ref. 10). 

Further information on trigonometric series will be found in 
Chapter IV. 


+ We do not assume the convergence of series (3.143). 
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6. Asymptotic series 


If a function F(x), defined for x = Xo, is to be considered for large 
values of the argument x, it is sometimes useful to find a function 
S(x) of simple structure such that 

R@&®) = FO)-S@)-0 as x+0&, 


In this case F(x) can be replaced by S(x) for large x. If F(x) admits 
of the expansion (for x> x)): 


vA A, A 2A 
FQ) = dott tga t= 2 SE. G.146) 
we find, on putting 
he Bis go de An 
Sq) = ao = 4 +F+...49 (3.147) 
and 
<= AR 
R(x) = FX)—s)(x) = ioe p= = Catt «+, (3.148) 
eT 
that 


lim x"R,(x)=0, or R,(x)=0 (=) 3 (3.149) 
Noo x 
ie. R,(x) is an infinitesimal of higher order than n. 

If F(x) does not admit of an expansion (3-146), it is still sometimes 
possible to choose a series of the form (3.146) such that condition 
(3.149) is satisfied for any fixed n. 

Series (3.147) is said to be asymptotic for F(x), and we write 

aad 
F(X) ~ Pe =k 


ae (3.150) 


Series (3.147) can be divergent, but it is still useful since it yields 
the approximate formulae 


Fx) = = Ayr fn 


Hee toa 


the degree of the approximation being indicated by (3.149). 
EXAMPLE 38. Let us consider the function 


Fx) = [rend 
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Repeated integration by parts gives: 


1 2! J em Hed 
Fx) = ote .+(- 11 + 8), 
where 
oo ext 
R(x) = el ari dt, 
x 
00 exnt et fsa 00 ex-t 1 
| pid = — Fart ~ men | pa Ut = Sari? 
x rd 
consequently, 
1 Ra()| < rice 


and condition (3.149) is satisfied. Thus 


This series is divergent, since 

lim a, = lim (- yp Org 
n—> co R—> co 

If F(x) admits of an asymptotic expansion, this latter is unique. 

The asymptotic expansion of the product of two functions F(x) 


and G(x), each of which has an asymptotic expansion 


oo, 


FQ) ~ 3 Agen, Gx) ~ FS Bye k, (3.151) 
k=0 k=0 : 
is formally equal to the product of asymptotic expansions (3.151): 
FOG) ~ Ft Age Fo Byx-k = F Cyr, 3.152) 
k=0 k=0 R=0 


where 
m 
Cn = ¥. ApBm-r (3.153) 
k=0 
If the asymptotic expansion (3.150) of F(x) starts with the term 
Agx~*, it can be formally integrated term by term in the interval 
from x to + ©, i.e. 


[7 Foe ~ > ie Ah oy = 3 es 


k=2 
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Formal differentiation of asymptotic expansion is not permissible. 
If F(x) has an asymptotic expansion with no free term (A,= 0 and 
F(x) ~ 0 as x + o), this expansion can be exponentiated 


eF@) — [4 x - [Fer ~ 
m=: 


Ay At A, | 1 
wisSe 4] Be gates: (3.154) 


The asymptotic expansion is thus a source of approximate formulae 
for computing a function for large values of its argument, the acc- 
uracy of formula (3.147) being the greater, the greater the value of 
the argument. 

There exist functions, not identically zero, for which all the coeffi- 
cients A, in the asymptotic form (3.150) are equal to zero. Such 
functions are described as asymptotic zeros. An asymptotic zero is 
any function F(x), for which 


1 
F(x) = 0 (=) 


for any n. For example, F(x) = e~* is an asymptotic zero. Addition 
of this function to the left-hand side of (3.150) does not change its 
right-hand side. 

Not every function F(x), defined in the semi-interval [a, + ©], 
admits of an asymptotic expansion (3.150), but if such an expansion 
exists, it is unique for the given F(x) (the coefficients are uniquely 
defined). On the other hand, there exists for any sequence of numbers 
{4,} a function F(x), for which the 4, are the coefficients of an 
asymptotic expansion (3.150). This F(x) is not uniquely defined, 
however (to an accuracy of an asymptotic zero). 


7. Some methods of generalized summation of divergent series 


Certain classes of divergent series, i.e. series lacking a sum in the 
ordinary sense of the word, are capable of generalized summation. 

The definition of generalized sum usually satisfies two condi- 
tions: 

1°. The linearity condition. If the generalized sum A corresponds 
to the series }'a,, and the generalized sum B to )'b,, the series 
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X(pa,+4b,), where p and q are arbitrary constants, must have a 
generalized sum equal to pA+qB. 

2°. The permanence condition. If a series is convergent in the 
ordinary sense to the sum A, it must also have a generalized sum, 
equal to A. 

The general plan for constructing linear permanent methods of 
summation is as follows. 

Let 

Yo(*), ri), see Yn(*)s ress: (3.155) 


be a sequence of functions given in a domain X of variation of the 
parameter x, and let ¥ have a point of condensation — the finite or 
improper number o. 

We construct, in accordance with the numerical series 


Ons (3.156) 
n=0 
the functional series 
D Gnn(X). » (3.157) 
n=0 


If this series is convergent, at least for x sufficiently close to w, 
and its sum S(x) tends to a limit A as x ~ », this number 4 is in 
fact taken as the generalized sum of series (3.156). To ensure that 
the method has permanence, two conditions are imposed on the 
functions y,(x): 


(1) lim wZ)=1 @=0,1,2,...)3 (3.158) 
(2) for all x € X: 
[y+ ¥ lr rnd) sK<- — (K= const). (3.159) 


We shall next consider two methods of generalized summation, 
embraced by the general plan just described. 

1°. The method of power series (Poisson). In accordance with the 
given numerical series (3.156), we form the power series 


Y agx” = Ag+ ayxt ... tayx™ + 0065 (3.160) 


neo 
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if this series is convergent in the interval 0 < x < 1 anditssum S(x) 
has the limit 4 as x > 1: 


lim S(x) = 4, 


n-r 1-0 


the number 4 is called the generalized sum (in Poisson’s sense) of 
the given series (3.156). 
This method follows from the general scheme if we put 


t¥= (0,1), @=1, yx) = 2" (n= 0, 1, 2, ...).° 
EXAMPLE 39. Let us take the series discussed by Euler: 
1—14+1]—-141-—-14+.... (3.161) 


It has no sum in the ordinary sense, since s,, oscillates between 0 and 
+1. The corresponding power series (3.160) has the form 


l—xtxP— x8 extend oe x (-—1)*x". 
nx 


For 0< x <1, itssum (asthe sum of an infinite geometrical pro- 
gression) is equal to 


S(x) = = ; (3.162) 


the generalized sum in Poisson’s sense of series (3-161) is 
i i 
Az lim ~—=+. 3.163 
x~i-ol+x 2 6 ) 
EXAMPLE 40. The series 
,y sin nO (-x s 60872) (3.164) 
n=l 
is convergent only for = 0 and §= +2. The corresponding 
power series 
>. x" sin 1 (3.165) 


n=l 
has the sum, forO<x<1: 


x sin 8 


S{x) = 1—2xcosé+ x? ° 
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The generalized sum is thus equal to 


A= lim po NS ad = Es = ota 
pp qeo L—2xcosO4+x% ~~ 2(1—cos#) 2 2 
(3.166) 


2°. The method of arithmetic means (Cesaro). We take the partial 
sums s, of the given numerical series (3.156): 
So=%, SH Ata, 


n (3.167) 
Sg = A +Q+4, ---, I= x a, 


and form their consecutive arithmetic means: 


Sot Sy | : Ae et sss +5na1 (3.168) 


Ay = Sq, Ag = 2 “a8 - 


If the sequence {A,} has a limit 4 as n -» co, we call A the generalized 
sum (in Cesaro’s sense) of series (3.156). 
This method follows from the general plan if we put 


eee for m=0,1,...,n—-1, 
X= 1, O = +, y(n) = n 
| 0 for men. 


EXAMPLE 41, Let us return to series (3.164). When » # 0: 


cos +6 —cos (» +5)0 


2 
Sn = 1 ’ 
2 sin 6 
a 4 cotan 6 — a ; 
4 sin? > 6 


j 1 7] 
A= lim 4,=—>cotan=. 
We have thus obtained a generalized sum in Cesaro’s sense equal 
to the generalized sum in Poisson’s sense. 
The inter-relationship between the Cesaro and Poisson methods 
may be explained by quoting the following theorem: 
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THEOREM 23, (Frobenius). Jf a series is summable in accordance 
with the method of arithmetic means to the finite “sum” A, it is simul- 
taneously summable by the method of power series, to the same sum A. 

Notice that Poisson’s method is applicable to a wider class of 
Series than Cesaro’s method, though it does not contradict Cesaro’s 
method when both are applicable. 


§ 3. Methods of calculating the sum of a series 


We shall discuss in this section some methods of finite summation 
of series, some estimates for series, finite sums and products, and 
the problem, of importance for practical computation, of improving 
the convergence of series, ic. methods enabling a given series to be 
replaced by another, having the same sum but more rapidly con- 
vergent. 


1. Elementary methods of exact summation 


It is very rarely possible to sum exactly an infinite series obtained 
as a result of solving some problem. Some simple methods of strict 
finite summation are given below. 


THEOREM 24. If the terms a, of the series ) a, can be written 


n=( 
in the form a, = b,—b,,, and if the b, form a sequence {b,} having 
a limit a, the sum of the series is 


S= ¥ a, =by—a. (3.169) 


n=0 


EXAMPLE 42, Suppose we have the series 


oO 1 . 

2s Jat (nena * 
Se ets ee ae See 
Jatn+l)(Jn+Jnt+]) Vn Jntl’ 


and lim 1/Vn = 0, so that S= 1 (b=), = 1). 


Rn-—> oo 


here 
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THEOREM 25. If the terms of the series }. a@, are expressible as 
n=0 


On = Cyber +eadaegt +++ +e pPaaps (3.170) 


where p is some fixed positive integer = 2, b, form a sequence having 
a limit a, and x; are numbers satisfying the condition 


a $e+... +a, = 0, (3.171) 
the series in question is convergent, and its sum is equal to 
S = aby + (ay tag bgt ... Het to. $&%p-r)bp + 
+ (%q +2%3+3%,+(p—l)ep)a. (3.172) 
Exampte 43, Given the series 


= 4n+6 
ney (1 + 1) (+2) (2 +3)’ 
we have 
4n+6 1 2 3 


(n+ 114 2) (743) mel nt2 nts" 
Consequently, «, = 1, a, = 2, a = —3. 


Condition (3-171) is satisfied : 1+2-—3 = 0. In addition, 5, = 
=1/n + 0 as n + oo, We now find, by (3.172): 


1 5 
S=11+0+)5= 5. 


THEOREM 26. If the terms of the series 5, a, can be written as 
n=0 


aq = by, aot Onsg 


where q is a positive integer, while the sequence of numbers by, 5, 
by, ... has a limit &, the sum of the series is 


S= yan = bo tht... +b. 1-98. 
tea 


Tables of series expansions of functions and the relevant sections 
of reference works may be used for the finite summation of series. 
Given a particular series, it should be verified whether or not it 
is to be found in a reference book, or whether it can be transformed 
to a familiar series by a change of variable or some other means. 
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EXAMPLE 44, Suppose we have the series 
¥ kp*sinkx, |pi< 1. 
R=1 
We find in ref. 7, formula 1.447 3, which we can write as 


— 72 
Pe re ee es (pl <0. 


1 
2 1-2pcosx+p? 2 


The uniform convergence of this series and the series of the deriva- 
tives of its terms with respect to x follows from comparing them with 


the majorant series 5 [p|*and ¥; k|p|* respectively. On differen- 
kel kel 


tiating both sides of the equation with respect to x, we find the sum 
of the series (see § 2, sec. 1): 


= ae _ __PUi—p?*) sin x 
pH kp* sin kx = rer rrr. (jpi<D. 


2. Summation of ‘series with the aid of functions of a complex 
variable 


If the trigonometric series 


a4 F a, cosnx = f(x), (3.173) 
n=} 
¥ aq sinnx = f,(x) (3.174) 
n=l 


have positive coefficients ¢,, and the series } a,/n is convergent, 
nel 
(3.173) and (3.174) are the Fourier series of continuous functions. 
We can sometimes find the functions f,(x) and f,(x) — the sums 
of series (3.173) and (3.174) — by making use of functions of a 
complex variable. 
Let 


deny aes 
92) = ao > yz” 
net 


be the sum ofa series convergent in the circle |z|< 1. If lim g(z)= 
fzejm1 
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= lim o(re*) = g(e™, thenf(x)+ii(~) = 9(e™), ie. after separating 


the teal and imaginary parts of y(e*), we have: 
A(x) = Re {p(e*)}; (3.175) 
Salx) = Im {p(e*)}. (3.176) 


EXAMPLE 45. Let us establish the convergence and sum of the 
series 


cosx cos 2x 2 COS 2X 

cers ae ees oes ae 3 mr? (3.177) 
sinx sin 2x <2 sin nx 
os 7 AS Serie (3.178) 


The convergence of series (3.117) and (3.178) follows readily from 
a comparison with the series 


= 
Et Dae 
which is majorant for the given series. Furthermore, we put 
oo 2 
p@) = 1+ Y=. 
n=, MN: 


On expressing z in the exponential form z = re* and letting r tend 
to 1, we have 


ec = ecosxtisine — 9608 cos (sin x) + isin (sin x)] = 


es feos x+isin 9)" 


’ 


n= 
e°°8® cos (sin x) + ie°°** sin (sin x)= 1+ es SOS TES 3} iy == ; 
n=l { 
Hence, 
1+ x cos sei = 6° ogg (sin x) (3.179) 
ney nt 
y sin nx = e608 X gin (sin x). (3.180) 


no, ont 
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3. Summation of series with the aid of Laplace transforms 


Definition of the Laplace transform. Suppose that, given any x>0, 
the modulus of the function (x) increases more slowly than some 
exponential function i.e. there exist numbers M and so, not depending 
on x, such that, for any x, 


| p(x) | < Me%*, (3.181) 
Let p = s+io be a complex number. The integral 
a(p) = i e~P*y(x) dx (3.182) 
a 


now exists and has derivatives of all orders in the half-plane 
Re p > So. The integral (3.182) is called the Laplace transform of (x). 
In the accepted brief terminology, p(x) is the pre-image, and a(p) the 
image. 

Tables have been compiled for the pre-images and images of many 
functions (see for example ref. 7). 

Summation of numerical series (ref. 9). If, given the convergent 
infinite series 


ne > (+) *a(k) (3.183) 
‘= 
its terms are images of a pre-image 9(6), i.e. 
a(k) = le e-*g(e) de, 
0 


the following formula holds (preserving the correspondence of the 
+ signs): 


> a  o() dé 
2, OE Dal = #[ eet" (3.184) 


EXAMPLE 46, Knowing that - 


a 0 
—— = —ké gi 
aw t e-* sin af dé, 
we have by (3.184): 
= 1 _ i sinaédi xz n 
mPa = : ee ee Bq Cotanh xa ——. 
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Generating functions. If the terms of the sequence {f,(f)} (k = 1, 
2, 3,...), defined in some interval a<t<f, are the coefficients or 
the Taylor expansion of a known function F(x, t) in powers of x fof 
|x}<1, ie. 

F(x, = ¥ xt Gt) (3.185) 

k=l 
F(x,t) is called the generating function of the sequence {f,{t)}. For 
example, one of the following sequences can be taken as {/,(¢)}: 

(a) the sequence of powers 1, t?, ,..., where 


F(x, ) = — 7= oy xhyh, (3.186) 


and |xt| <1; 
(b) the sequence of trigonometric functions 


sint, sin2t, sin3s... 


or 
cos?, cos2t, cos 3t,... 
where 
= xsint ae ere 
F(x, O= Tinea ae x sin kt (3.187) 
and 
xcos t—x? oe 
F(x, t) = Tix costpe = Ps cos kt. (3.188) 


where ¢ can vary in any interval and |x| <1; 
(c) the sequence of Chebyshev polynomials T,(x), T,(x), T3(x), .. +, 
for which the following relationship holds: 
Pope cewta A SP 
F(x, t) = i= ook T(t): (3.189) 


where |t| = 1,]x| <1; 
(d) the sequence of Legendre polynomials P,(t), P(t), P3(t),..., 
where 
1 


F(x, y)-=—— 
me Jx?—2xt+1 


-1= ¥ xP,(0, (3.190) 
k=l 


for |¢| = 1 and |x| <1. 
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lt should also be noticed that the infinite series (3.186)-(3.190) are 
convergent for x = + 1 or oscillate between finite limits (i.e. the 
sum of the first m terms remains less in absolute value than some 
constant independent of ¢ and mm). 

The summation of functional series (ref. 9). Suppose that the 
generating function F(x, t) is known for an infinite sequence of 
functions {f,(t)} (k = 1, 2, 3,...) (see above). Let the series 


St, = > a(k)x* f(t) (3.191) 


be convergent in some intervale < t< Band for |x| =1. Ifthe coeffi- 
cients a(k) of series (3.191), considered as functions of the index 
k, are images of some 9(&), we have for the sum of series (3.191): 


St, = i ” (G) Flocent, 1) dé, (3.192) 
0 


ExaMPLe 47, Knowing that the fraction 1/(k+J) is an image of 
e~* for any /=0 and k >0, ie. 


I oo 
—= —(h+be 
k+l i r a, 


and using formulae (3.187), (3.188) and (3.192) for positive integral 
, we have: 


es x sin kt 
Si, x) = Pay ara = 
U h\— 1y7-1 mM 
= xt y Se Cr(— Dx" sin (r—Dt+sin “| - 
me=1 m r=, 
sin It x sin t 
- bar, Ya In a = 2x cos t-+x?) +. cos lt BIC an = eed } 3 (3.193) 


2 x® cos kt 
Sine ye 
a x) Py k+l 


=x | . a [ 2 C7,(— 1)"x" cos (r—Dt-- cos u)- 
mol tT 


cos It xsint 


ais as In (1 — 2x cos t+ x®)-+ sin /t arctan aera \. (3.194) 
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Formulae (3.193) and (3.194) remain valid for any ¢ and |x| =1, with 
the exception of points of discontinuity (ref. 11), which may make 
their appearance for the trigonometric series with x = +1. 

On making use of generating functions (3.186), (3.189), (3.190), as 
also (3.192) with positive integral /: summation formulae similar to 
3.193) and (3.194) can be established for the series 


= tt = x*T,(t) = x*p,(t) 
, and 
k=1 +1 ps k+l Px k+l 


4. Integral estimations for finite sums and infinite series 


Euler’s formula. If a function a(x) has derivatives up to and in- 
cluding the nth order for m= x = k (mand k are positive integers), 
the following formula holds, due to Euler: 


Ari R n=l B 
> a(t) = | a(t)dt+ > sr la? MR) — a(n) - 
m wal ** 


tm 
Ly a™\e4¢1-Ha 3.195 
~at |, nO) Da (e+1—t)dtt, (3.195) 
where Y,(t) = B,(t)—B,, B, are Bernoulli numbers, B,(t) are 


Bernoulli polynomials (see Chapter VI). 


First integral estimate. We suppose that a™ (x) & Oft in the interval 
qQ=xs p+ (p and gare positiveintegers). Let M,, denote the greatest, 
and m,, the least, value of Y,,(t) in the segment0 St=1. The following 
inequality now holds: 


slp +1, Q—*P [ap +1)—a-M(Q)] =z Fak) = 
a al 
= 5P +1, N——F[a-Mp-+1)—a"—V@)], 3.196) 


t+ When n=1 we have to assume oy (By/?)) (a#—- 9K) ~ an) =0; in 


=1 
addition, it is assumed here and throughout what follows that fOx)= 19+ 
tt If a(x) a0, the inequality signs of (3.196) have to be reversed. 
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wheret 


pti n-1 B 
saipts a= [att ar 5 Fetal Mp + a0) 
wm) *: 


q 
Let us quote some values for M,, and m,: 


RE 
16’ 


It can be shown that 


My =<, m, = 0; Mg ~ 0-0244582..., m, ~ —0-0244582.... 


My = Yx (z) >0O and m,=0, if J is even 


2 
If we make the following assumptions: 


My =O and my= Yaz) <0, if Jis odd. 


(a) a \x)20 for gqaxx<a~; 
(b) fim a™(x) = 0 for m=0, 1, 2,..., 2-1; 
rp oo 
(c) the integral |} a(x)dx is convergent, 
q 
we now get, by (3.196), as p — o: 


M 
Sn (+0, + os a" (Q)s 


= x a(k) S 5_(+ -, 9) +7 a™-V(q), (3.197) 

=q ! 

where 
0 noi B 
S(t, 9) = ( a(t) dt— Py = at-(q). 


q 
EXAMPLE 48. Knowing that the derivatives of any order of a(x) = 
=] [vx are sign-definite in 1 = x = 101, we can estimate the sum 


by making use of (3.196). 
Be tgtv—1) (p-+1)—al¥-1(q)] =0. 


n-1 
+ When n=1, we have to assume y I 


Pel 
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We have, for instance, 
18l<S<19 ‘for n=1; 
18-55 < S < 18-61 for n=2; 
18-5890 < S < 18-5909 for n= 6. 


Second integral estimate. If we assume that (—1)™—? a™ (x) = OF 
for ga xSptl, the following inequality holds: 


B 
Samp +1, 9) + ml [a2™-Dp + 1) —a@m—1(q)] = 


p 
=D ah) = SmaP+l a, B.198) 
ag 
where 
‘p+ am=2 B. 
fam—i(P +1, 4) =| a(t) de+ Y Splae Me + )— a PQ). 
q ven 7 


If we assume: 


(a) (-—D"™1e2"(x)20t for gqax<+o 
(b) lim a@-Y(y) = 0 for k= 1, 2,..., m3 
x—> co 


~() integral | a(x) dx is convergent, 
q 
the following holds: 


Samal +, )— Ee amg) BF a) B Samaal + =, as 
(3.199) 


where 
0 2m=2 B 
fame +2 9) = [ a(t) dt— 9S Sa (Q) H. 
q bio . 
EXAMPLE 49. Knowing that, with a(x) = x72, the following 
condition holds: (—1)* a¥¥ (x) > 0 for all x > 0, we can carry out 
an estimate of the sum : 


100 
S= ¥ ka, 
k=1 


tIf (—1)"—'a@™\(x) = 0, the signs of inequalities (3.198) and (3.199) must 
be reversed. 
am=2 
tt When m=1, we have to put Y (B,/va’—Y(g) = Byala). 


vel 
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by making use of inequality (3.198) with m= 2. We have 
40501-2260 < S < 40501-2265. 


The first and second integral estimates may be used not only 
for evaluating finite sums and infinite series, but also for evaluating 
finite and infinite products. 

EXamPLe 50. Let us estimate the size of the product P = p!. 


p 
On taking logarithms, we have S= In P= )' Ink. 
ke 
Notice that the following conditions are satisfied for the function 


a(x) = In x in the interval 7S xsp+1: 


a(x) = i> 0 a’x= -4< Q and a’’(x)= 5 >0. 


On using (3.196), say with n = 3, we get 


s(p+1, DYE le"(P+- a") sn = 


= 5(p+1, 433 fap +) 2"Q) (3.200) 
where 


p+, 1) = (+z) ee+0-2| aes] 


On exponentiating inequality (3.200), we finally get 


_¥S (+pyp Y3 (2+p)p 
Lye 218 (p+1)* =p! < re (p+1)2 5 


where 
1 1 
pe pepe aera 


We next consider transformation of series for improving their 
convergence. 
5. Kummer’s transformation 


Suppose we have the series with positive terms: 


Rn = Ya (3.201) 
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and some auxiliary series 
Bm = ¥ bp (3.202) 
=m 


which is convergent and has a finite sum B,,. Suppose the finite limit 
exists: 
b, 


A= lim — #0. (3.203) 
n—> oo In 
In these circumstances series (3.201) is convergent (see Test III, § 1) 
and the following identity holds: 
Bini. S 1 by : 
Ry = 224 F (-3 7 a (3.204) 


n+m 


which is known as Kummer’s transformation for the series (3.201)- 


6. Improvement of the convergence of series corresponding to a 
given convergence test 


Transformation (3.204) can be used for improving the conver- 
gence of series (3.201). For, by (3.204), the convergence of (3.201) 
will be improved in the sense that the general term af)= 
= (1-3 (ql) of the transformed series } a will tend 

nm 
to zero faster than a,, i.e. lim a@/a, = 0. Obviously, the faster 


Io 


the ratio b,/a, tends to its finite limit A ~ 0, the faster the series 
on the right-hand side of (3.204) will converge. 

Transformation (3.204) can be applied several times in succession 
to the same series (3.201). 

Suppose, for example, that the terms of the auxiliary series 


BH = y oe (k = 0, 1, 2, ..., p) 


n=m 


are chosen successively so that 
(1) the sum B® (k = 1, 2, ..., p) is already known to us; 


(2) 4y = lim A®, where 4@ = 28 gieen = (7 48) gm 
= Tn Ans Waere n= gga? On o— Aye an’ 


all the A, being bounded and non-zero. 
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Now, on putting 4{)/4, = 1—e®, where lim e” = 0, we have 
after the pth transformation of (3.201): Si iad 


Ree ey act et (3.205) 
hw0 Ap n=m k=o 


_ It occasionally turns out that all the e®) = 0 for a certain k, 
and we get the strict sum of series (3.201). 
Every transformation of type (3.204) is determined by the choice 


of some series }° b,, which corresponds to some test which is sufficient 
nel 2 
for the convergence of the series }\ a,, obtained from Test III. We can 
nel 
say in this sense that, for every convergence test following from Test 


Ill, there is a corresponding method of improving the convergence 
of the series. It may prove convenient in practice to take all the b, 
b@, b@, ... equal or different in transformations (3.205), ive. 
to choose the stages in the improvement of the convergence in accord- 
ance with the convergence obtained by using different tests. We 
shall consider below, as an example of the application of transfor- 
mation (3.205), methods of improving the convergence of series 
corresponding to d’Alembert’s and Gauss’s tests. 

Improvement of the convergence of series corresponding to d’ Alembert’s 
test. We put in identity (3.204): b, = a,,,—a, = 4a, and take 


the series }° a, to be convergent by d’Alembert’s test, i.e 


n=1 
lim 2+! =p <1 
n> an 
Let @ ~ 0; then 
hed a, o Aa 
Rn ¥ a= 224 F (o-); (3.206) 
nem 0 nam 0 
where 
ey OS 
n> so Qn 


On again applying transformation (3.206) to the series 


eo 4a 
y a®, where a = a 
nm 0 
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we have 


The following notation is used here: 


14 Ba, 4 4 
on (ta) aera (1B) (Ina) 


Thus, p successive applications of the above transformation to the 
original series give (using the above notation): 


umm sag 
where 
hei 
day 4 (1-3) 
Ay = lim [* and 4, = lim — 8 : 
n—+>o an h-> co ae 
(a) 


(kK = 1, 2, 3, ..., p) 
Euler’s transformation. Given the power series 
YX a,x" (3.208) 
net 
suppose that the following conditions are satisfied; 


Attn 


lim “tt 1+ and lim =1 (3.209) 


noo Xy N—> oo 


(kK = 1, 2, ..., p). 


t+ This guarantees the convergence of series (3.208) with |x|<1 (see ref. 
11, vol. II). 
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We can now apply to series (3.208) the transformation (3.207), which 
reduces to the following familiar Euler transformation: 


oo a 1x pol " x \Rt 
Y Xq_x" = #2 a ( + 


net 1-x 


tcl Dy (APa,)x™, (3.210) 


EXAMPLE 51. Let «, = P(m) be a polynomial of degree m; it is 
easily verified that conditions (3.209) are satisfied here for all k = m, 
while we have in addition A*x, = 0 for any k > m. Now, on applying 
(3.210), we obtain, for |x| < 1: 
= _ Pd)x  & y, x \Rt1 
¥ Px” = aa ed ‘P(1) i= é 


n=1 1 
Improvement of the convergence of series corresponding to Gauss’s 


Sod 
test. Suppose that the series }° a, is convergent where the conditions 
nam 
of Gauss’s test are satisfied, i.e. 


Gng1 _ + pyr 4 on) 
a, + gl + y(n)’ 
where ¢(n) and y(n) have orders lower than 7 


G:—P,> 1 (see § I, sec. 5). 
If we put b, = (n+1)a,,,—na,, transformation (3.204) can be 


A-1 and in addition, 


applied to the series )) a,. We have 
n=m 
- Man 
Gp, = ——™— + 
aan Ga-Anl 
1 S pyhl+ pont 2 4 0. +h 


pacman » G211 
GP! kn QP ot. am ‘ ) 


+ 
where pi, Py ..-, P, are certain new coefficients not dependent 
on n. Transformation (3.204) for the series (3.211) can be repeated. 

EXxAmpie 52. If transformation (3.211) is applied twice to the 
series 
= 1 


ae Py n(n+1) 
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we get 

2 1 
S=—+6 —— ooo 
eT CENCE ICES) 


If we take into account only three terms of the last series, we get 
S x 59/60, while the exact sum is S = 1. 
EXAMPLE 53. Given the series 


ae (3.212) 
n=m 
where 
= : 
Pe @+OB+R) aig a+B—y <0, 


aeolkK +) +4) 


we can apply transformation (3.211) several times. We obtain after 
p transformations of the series (3.212): 


___ #6 
oe Wyp-a—B) * 
eB Pa Be (yt+-s—a)(y+s—8) 
+ yy a—B) he ht G45+ DO +s+1—a—B) 
(v+s—a)(y+s—f) & Gp, 
sf ee OD ee, 
geet OPES ERM TT Giaiey) 


sm0 


+ 


7. Abel’s transformation 


The identity 


= aB, = OnBr eo >: (@ —%p41)Br, (3.213) 


where B, = 3 B, is called Abel's transformation. It is the analogue” 


of the fori for integration by parts of finite sums. On letting 
k + coin (3.213), we arrive at infinite sequences {x,} and {f,}. 
It follows from (3.213), pemased {B,} is bounded and lima, = 0, that 


hoo 


Dk =F Cathe G.214) 
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This transformation can be utilized for improving the convergence 
of infinite series (see ref. 1). 
EXAMPLE 54. Let us improve the convergence of the trigonometric 


series 
Yiu, sinkx and } u,coskx, where lim uy = 0, 
het het 


with the knowledge that 


1 
h is 2 cos («+})s 
y sin ix= 2 cot 77 Sea e kya 
be 2sin— 
2 
and 
» sin (x+4)s 
=} 2 sin> 


On using transformation (3.214) after putting a, = u,, du, = 
== Uy, 1—Up, WE get: 


Pa uy cot 1 SS 1 
Su, sin kx = ——~—— + ¥Y du, cos, kK+— ) x; 
ReL 2 2 since Lose 2 

2 (3.215) 


y uy, cos kx = a : ¥, Au, sin ppd. x. (3.216) 

REL 2 2s xX re 2 
sin = 
2 
Obviously, these transformations of trigonometric series can 
conveniently be employed in the case when the wu, tend to zero slowly 
and lim Au,/u, = 0. The improvement in the convergence will be 


khpo 
the greater, the faster 4u,/u, tends to zero. 
If transformation (3.214) is applied a second time to series (3.215) 
and (3.216), we get 
iy up sinkx = (u—2) cot =— : ¥ Au, sin (k + 1)x 
hey 2 2 4 sin? xX pay 
in? > 
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and 
cos x 


¥ u, coskx = — B+ u- Up) 3 mH A*u, cos (k + 1)x, 


hel 4sin2 
sin?’ = 
2 


where 4?u, = u,,.—2u,,,+4, is a difference of the second order. 
For instance, if u, = 1/k, we have du, = 1/k(k+1), 


Atu, = 2/k(k+1) (k+2), ete. 


8. A.N. Krylov’s method of improving the convergence of 
trigonometric series 


If f(x) satisfies Dirichlet’s conditions, it can be expanded as a 
convergent Fourier series: 


f() = a+ > (ay cos nx + by sin nx), (3.217): 
nel 


where the Fourier coefficients a, and b, are of order 1/n if f(x) 
is a function of bounded variation. Such a series is slowly convergent. 
It is possible to speed up the convergence by isolating the slowly 
convergent part. Let f(x) have bounded derivatives of the kth order 
everywhere except for a finite number of points x1, x0), ..., x{0). 
At these points f(x) has a discontinuity of the first kind, the size of 
the jump A, being equal to 
hy = £4 +0) — SO -- 0) (i= 1, 2, ... mo). (3.218) 
Suppose that the jth derivative also has discontinuities of the first: 
kind at the points x9), x), ..., x0, with jumps 
AD = FOP +0)—fO (xP —0) (3.219). 
(i=1,2,...,m; j=l, 2,..., %). 


We can now write f(x) in the form 


mo | ; m | 
flo) = FHP agx— x) + F —APo(x— xf) 4... 
t=, 7 tei 7 


FS aPane—x) +908), 6.220) 
=1 
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or 
1 : 
fa)==y y Aa ,(x— x) +920), (3.221) 
j=0 lel 
where 
a for -—27%<u< 0, 
= sinnu 
ole) Pa n = for O<u< 2z, 9.222) 
0 for u= 0, 2x, —2x 
o,(u) = [- oo(u) du oe 5 seca 
0 n= 
2. 
baleen for —-2xsus0, 
Fy oe aes (3:223 
D4 for OsSus2a 
Further integration gives us o2(u): 
0,(u) =. — LS se eee (Osus2n), (3.224) 


The function (x) is continuous along with its first k derivatives, 
and its Fourier series 


P(x) = 2+ 5) (a, cos nx +B, sin nx) 
nel 


is rapidly convergent, since the coefficients «,, and f,, have the order 
i/nt+?, If we take into account the expansions (3.222)-(3.224), the 
series for f(x) will be 

Mo <o (oy oo 1) 
f@= sla 1) pu sin n(x — xf) ay io cos — xf) 


n t= 7 nel 


2° 2)" 
~F 1a sin n(x — xf D 
i a Pd we 


tot ¥ (&q cos nx+ fq sin nx), (3.225) 
n=l] 
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The slowly convergent parts have thus been separated out from 
Fourier series (3.217). 

We often obtain by some method the Fourier series for a function 
without knowing the function itself; here, if the series is slowly con- 
vergent, it is of little use for computing the values of the function, 
not to mention the values of its derivatives. It is often possible to 
improve the convergence in this case, by making use of familiar series 
for o(x—x,), etc. This will be shown with the aid of an example 
(ref. 3). 

EXAMPLE 55. We are given the Fourier series 


2 = 70s n= 
fw= ee Fay Sin nx (sxs2). (3.226) 


We separate out the lowest power 1/n from the coefficient: 


Me CE a th 
re i ar er 


The initial series can now be split into three: 


3) cos nz  COSn— 
fx)=-— > sinnx-— } 3— sin nx — 
% ne1 n=l 
2 = Cosas 
TT ks nom Sin nx. (3.227) 
The first two series are summable in the finite form: 
cosnZ= 
Sx) = -~= > sin nx = 
i 
sinn( x+— +sinn| x s 
gual 5 zip. 
ae n baa 
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.. sinn (+3) +sinn («-3) 
: 2 3 
= z[e («+ 5) +e (:-3)]. (3.229) 


| 
— 
° 
I 
x 
A 
la 
nN” 


x-% x 
Six) rt “z oy <XE7 i, (3.230) 
0 (« = 3) : 
xe on pees 
6x +24 =e oy 
S,(x) = (3.231) 
(x—aP 2x x 
| _ x + 5g &- 2) (Fere- 2 
Consequently, 
cos n= 


Sx) = S,(x) + 82(x) - = ps PPL) sin nx. (3.232) 


The remaining series is rapidly convergent (its coefficients are of 
order 1/n5) and the expression (3. 232) obtained enables us to evaluate 
easily the values of the function and of its first derivatives. 

In the case when the series given above for oy, ¢,, 0, are insufficient 
for improving the convergence, the following series may prove useful: 


cos x4008 2x +5008 3x4+ 6.0.5 


= —Re[in|1—e*}] = ~1n [2 sing (3.233) 
| 


SERIES 167 


and its analogue: 


cos2x cos3x cos oe 
ia P25, 134 


Pee 3 
2 sin — 


= (1—cos x) In 7) 


+ (=- z) sinx+cosx. (3.234) 


By using these last series, we can improve the convergence of any 
series of the form 


- 1\.. I . 
Bee [(4 (=) sin nx) +B (=) cos nx) sin nx + 
1\., 1 
+(C > } sin 2Xy9+D COS NXq | COS nx |, 


where A(1/n), B(1/n), C(1/n), D(1/n) are analytic functions of 1/n 
for small values of the argument. 


9. A. S. Maliev’s method of improving the convergence of 
trigonometric series 


The Fourier series of a function is slowly convergent if it has deri- 
vatives of all orders inside the interval (0, 27), while the function 
or one of its derivatives has different values at x = 0 and x = 2. 
The following method was proposed by A. S. Maliev for obtaining 
a rapidly convergent trigonometric expansion of a function of this 
kind. 

Let f(x) be given in the interval (0, 2), where it has continuous 
derivatives up to and including the (k—1)th order and the Ath 
derivative satisfies Dirichlet’s conditions, This function can be expand- 
ed as a series in functions cos 2mx and sin 2nx, or as a series in sin 
nx only or in cos 2x only (depending on whether the continuation 
of f(x) into the interval (—z, 0) is even or odd). These series are 
in general slowly convergent. We can arrange for order 1/n*+} in 
the Fourier coefficient if we first continue the function into the 
interval (—z, 0} in such a way that, when continued periodically 
on to the whole of the real axis, the function has k derivatives, where 
the kth derivative satisfies Dirichlet’s conditions. 
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For this, we take f(x) in the interval (—z, 0) in the form, say, of 
a (2k— 1)th degree polynomial g(x), having, along with its derivatives 
up to the (k—1)th order, values at the points 0 and x, respectively, 
equal to the values of f(x) and its derivatives at x = 0 and x = 2, 
We can conveniently choose y(x) as 


g(x) = (x +7) [Ata +e 1)! a] = 


+x [ +Bixtat. tgs DI (x sot]. 


The coefficients Ay, Ay, ..., 4,13 Bo, By, ..-, By, are now deter- 
mined successively from the equations: 
90) = ny = (0), 
p'(0) = kat-1A,+2*A, = f'(0), 
g-D0) = CP K(K—1)... 27Ag + Chyk(K— 1)... 3A +... 
weet ChotkrRM1A, 2 + Chitty, = £990); 
P(—2) = (—7)*By = fm), 
p'(—%) = k(-a)F-1B)+ (—m)PB, = fm), 
pm —7) = CP k(k—1)...2(—m)By+ 
+Chyk(k-1)...3(—2)PB, +. 
+ RH = f°, 
After constructing the polynomial (x), we get the function 
Q(x) for -xn=sx=0, 
yx) = 
J) — for Osxsx 
This function, continued periodically, has k—1 continuous deriva- 
tives and a kth derivative satisfying Dirichlet’s conditions. The 
Fourier series for y(x) is as convergent as 1/n**1 and yields f(x) in 
the interval (0, 2). 
EXAMPLE 56 (ref. 3). 


f) = x-> Os<xe=n). 
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Let k = 3 (for convergence of the order 1/n*), Now, 


9) = (+9) (—ga-gs*— 3) + 
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+2 | -ga-ga ets — freee]. 


On expanding as a series the function 


px) (-tsxs0), 


va) = i 2x7), 


fo= 240 x (a a) cos mx 0 


3 : 4 
TW noi, 3,5...\ 2 


nm, 4, 6,... 


ee 
= sin nx. 
n 


CHAPTER IV 


ORTHOGONAL SERIES AND 
ORTHOGONAL SYSTEMS 


Introduction 


A sequence of functions {/,,(x)} is said to be orthogonal in the 
interval (a, 5) if, for i # j, 


[sense dx = 0. 


An important role is played in analysis by the representations 
of functions as orthogonal series: 


& Cnfalx)s 

nel 
i.e. series in an orthogonal system of functions. Trigonometric series 
are the classical example of orthogonal series. 

The theory of orthogonal series arose in connection with the 
solution of problems of mathematical physics by the so-called Fourier 
method. Linear integral equations with symmetric kernels may also 
be solved by means of orthogonal series. 

The theory of orthogonal systems of functions has a remarkable 
analogy with the theory of orthogonal systems of vectors (see Chapter 
Il, § 1). This analogy was observed long ago and has been reflected 
in the terminology. It led in the course of time to the conception 
of Hilbert space — the infinite-dimensional analogue of n-dimensional 
Euclidean spaces (see Chapter II), the role of orthogonal systems 
of vectors being played in Hilbert spaces by orthogonal systems 
of functions. To provide a valid basis for the theory of orthogonal 
systems of functions, the basic concepts of analysis had to be gener- 
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alized; in particular, generalization of the concept of integral led 
to the Lebesgue integral. 

The more elementary part of the theory, and especially the “com- 
putational” side of it is described in the present chapter. Unless 
there is a special proviso, the integral is understood in Reimann’s 
sense throughout this chapter. 

n-dimensional vectors can be interpreted as functions defined at 
n points; this interpretation is discussed in broad outline in §1, 
sec. 1; it throws into greater relief the analogy with orthogonal series 
of functions. Biorthogonal systems of functions — the analogues of 
biorthogonal systems of vectors — are discussed in § 2, sec. 6. The 
first example of such a system was offered by P. L. Chebyshev in 
connection with interpolation problems. 

Orthogonal systems of functions are connected with problems 
of approximation of complicated functions by simpler ones, when 
the measure of the closeness of two functions f(x) and 9(x) is provided 
by their square derivation: 


i Lf) — oP dx. 


The problem of the best approximation (from this point of view) 
of a function by polynomials led to the creation of the theory of 
orthogonal polynomials (the simplest system of orthogonal functions). 
The first example of an orthogonal system of polynomials was the 
system of Legendre polynomials. The general theory of orthogonal 
systems of polynomials is due to P.L. Chebyshev. This theory is 
described in § 3. 

The classical systems of orthogonal polynomials are discussed 
from a unified view-point in § 4, sec. 1-4. 

The later sections of § 4 are devoted to concrete systems of poly- 
nomials — those of Legendre, Jacobi, Chebyshev, Hermite, Laguerre 
(as also Chebyshev’s analogue of Legendre polynomials for a finite 
number of points). Good uniform approximations of functions 
can be obtained in a number of cases with the aid of segments of 
series in orthogonal polynomials. Such approximations are obtained 
very often from segments of series in Chebyshev polynomials (see 


§ 4, sec. 7). 
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§ 1. Orthogonal systems 


1. Orthogonal systems of functions defined at » points 


Logically, the simplest example of an orthogonal system of functions 
is provided by a system of functions that are defined at n points. 
We shall confine ourselves to functions of one variable (everything 
said can be generalized immediately to functions of several variables). 

Let x, x2, ..., xX, be a finite set of numbers (or points of the 
real axis) and let f(x,) be functions defined at these points. Each 
such function can be regarded as a vector f with components f, = f(x,) 
(i= 1, 2, ..., ”). The length or norm of such a vector is 


if ll= [EI (4.1) 


The set of these vectors (functions) forms an n-dimensional Euclidean 
space, which is denoted by the symbol E,(x,, %:, ...,,) (see Chap- 
ter Il). 


A basis in E, (Xy %g,-++ %,) is any system of n linearly in- 
dependent functions f, f®, ..., £™ on the set xy Xg, -..5 Xs 


2. Orthogonal systems in E,(x,, 2, ..-, Xp») 


Functions f(x,) and (x,) are orthogonal on a set of points x1, Xp, ..., 
Xyy if 


9) = ¥ fier = 3 Mado) = 0, 4.2) 


which corresponds to the orthogonality of the vectors with coordinates 
f,and oi = 1,2, ..., m). 

A system of functions f™ (x,) (k = 1,2, ...,J) of E, (1, Xa) «+ + Xp) 
is said to be orthogonal if 


: UfO|z=> 0 for k=j, 
) pth) a 43 
mF) { 0 for k#j. ’) 


An orthogonal system of n functions is described as complete. 
There exists in £, (x, X,, ..-, X,) an infinite set of orthogonal 
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systems of » functions {FO} G=1, 2, ..., m); the functions of 
each such system form an orthogonal basis in space E,, (x), X2, ..., Xn)» 
Every function f(x,) of E, (1, ..., ¥,) is linearly expressible in terms 
of the functions of an orthogonal basis: 


fee) = ¥ 6S. (4.4) 


The coefficients c; in (4.4) are called the Fourier coefficients of the 
function fin the system of functions f, f, ..., f°, where 


6 = LF) = ¥ feds). (3) 


The coefficient c; is the projection of the vector f on to the base vec- 
tor f®, 

If {| f™ || = 1 for allthe f® (j = 1, 2, ..., m) of an orthogonal 
basis, the basis is said to be orthonormalized. If the basis f (j = 1, 2, 
..., is orthonormalized, we have for any function /(x,) of £, (x, 


Xe, 60-3 Xy)! 


it = ¥ 4, (4.6) 
j=1 


where the c; are the Fourier coefficients of the function fin the ortho- 
normalized system {f4} (this follows from (4.4) and the linear 
properties of the scalar product). 

If an orthogonal normed (|| f || = 1) system is not complete, i.e. 
the number of its elements / < n, instead of equation (4.6) we have 
the inequality 

t 


Is iP = >» }. (4.7) 


Equation (4.6) and inequality (4.7) transform in the limit as n + 
to Parseval’s equation and Bessel’s inequality respectively (see § 2, 
sec, 4). 
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3. The best mean square approximation 


The square approximation of a function f(x) by a function ¢{x) with 
respect to a system of points x,, x2, ..., x, is defined by 


\f—ell =| 3 Ued—eeor. 4.8) 


We shall discuss generalized polynomials of the Ith order, i.e. 
functions of the form 


Sy fad, 49) 


where {f™} (k = 1, 2, ..., J; <n) is an orthogonal system of 
functions of E, (xy, Xq, ...1 Xp) / 

THEOREM 1. From among all the “generalized polynomials” of the 
l-th order (1 = n), the best mean square approximation of a function 
S(x,) at the points x, x2, ..., X,, is given by a polynomial of the form 

! 


: DY nf), (4.10) 
Rey 
where c, are Fourier coefficients. 
This Ith order polynomial coincides with the sum of the first 7 
terms of sum (4.4). This best approximation vanishes when / = n. 


4. Orthogonal systems of trigonometric functions 


The most important examples of orthogonal systems on a finite 
set of points are first the orthogonal systems of polynomials introduced 
by Chebyshev (see § 4, sec. 11), and secondly, orthogonal systems 
of trigonometric functions. 

EXAMPLE 1. The system of functions {cos kx,} (k = 0, 1, 2, ..., ”) 
is orthogonal on the system of 2m points x, = ix/n (i= 0, +1, +2, 
..+, tn—1, —n). Any even function /(x,), defined at these points, 
is expressible by the sum 


f(xe;) = 4+ Cp COS KX, (4.11) 
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where 
1%) 
Ch =— > f(x) cos kx, 
1 ima 


EXAMPLE 2. The system of n—1 functions {sin kx,} (k = 1, 2,..., 
n—1) is orthogonal on the system of 2n—1 points x, = ix/n (i= 
=+1, +2,..., tn—1, —n). Any odd function ¢(x,), defined at 
these points, is expressible as 

nol 
Ax) = FY e, sin kx, (4.12) 
kel 
where 


1 7 5 
alee one o(x,) sin kx,. 


EXAMPLE 3. The system of 2” functions cos kx, sin /x, where 
k=0, 1,2, ...,”;/= 1, 2, ..., 2-1, is orthogonal on the system 
of 2 points 


4 =—= i= 0, +1, £2,..., n—1, —n). 


Any function (x,), defined at these points, is expressible as 


en t+ (aq, cos kx; +b, sin kx). (4.13) 
where 
= a= =, = p(x;) cos kx, 
= b= De p(x) sin kx,. 


Formula (4.13) reduces to (4.11) if y(x) is an even function, and 
to (4.12) if p(x) is odd. 

Any periodic function p(x,), defined at all points x; = ix/n, where 
iis any integer, is expressible by (4.13), or by (4.11) or (4.12) if it 
is even or odd. 

These formulae, deduced by Euler and Lagrange, transform to 
(4. 42) and (4.43) asm -- oo, They are atthe basis of numerical methods 
of harmonic analysis 
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§ 2. General properties of orthogonal and biorthogonal systems 


1. Orthogonality. Scalar (inner) product 


The orthogonality of two vectors in n-dimensional Euclidean 
space is well known to consist in the fact that their scalar product 
vanishes (see Chapter I, § 1, sec. 3). The orthogonality of functions 
is defined by analogy with the orthogonality of vectors. 

The scalar (inner) product of functions f(x) and g(x) on [a, 5] is 
defined by the expression 


he i ” foxes) dx. (4.14) 


(We naturally assume here that f(x).g(x) is integrable in [a, 5).) 
If 


a= { ” fidelx) dx = 0, 


I(x) and g(x) are said to be orthogonal on [a, 5}. 
EXAMPLE 4, The functions sin x and cos x are orthogonal on the 
segment [0, 2], since 


0 


[sin cos de = es 
is 2 

The orthogonality of functions with respect to a weight function 
is a further generalization of the concept of orthogonality. 

Let p(x) be a fixed non-negative function in [a, 5]. 

Any two functions f(x) and g(x), for which 


| ” dep dx = 0, (4.15) 


are said to be orthogonal on the segment [a,b] with respect to the 
weight p(x). 

EXAMPLE 5. The functions sin (n arc cos x) and cos (narccos x) are 
orthogonal on [—1, +1] with respect to the weight 1//1—x?*, since 


+1 1 
| sin:( arc cos x) cos (7 are cos x} dx = 


-1 V1—x? 


= sin mu-cos nu du = 0. 
0 
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All the integrals considered in this chapter will be assumed to 
exist in Riemann’s sense. 


The concept of orthogonality can be generalized in a natural manner for 
functions f(x), g(x) and the weight p(x), which are Lebesgue but not Riemann 
integrable. 

Let p(x) be non-negative in (a, 5], non-zero ona set of measure zero and Lebesgue 
integrable on [a, 5]. Now, 


P(x) dx > 0, 
a 


Pb b 
Let f(x) be such that | (x) dx exists in the Lebesgue sense. Then | {2 (x)p(x) dx 


a a 

also exists. We say in this case that f(x) is square integrable with respect to the 
weight p(x) on (a, b] (in the Lebesgue sense), and we write Li 5) for the set 
of such functions. 

If p(x) a1, we use the simple notation L*(a, 5). 

For instance, the function f(x)=x7'/? belongs to L°(0, 1), whereas f(x) = x7"? 
does not. 

The following proposition holds: if f(x) and g(x) belong to Lola, 6), then 


> 
| SX) g@)p(x) dx 


a 


exists, and the Cauchy—Bunyakovskii inequality holds: 


b i PR 
S@)g@)pe) dx = J Prone ae | 8°(x)p(x) dx 


a a a 


(this latter is a generalization of the corresponding inequality for vectors, see 
Chapter II, § 1, sec. 2). 


The scalar product in Lp(a, 5) of functions f(x) and g(x) is defined by the 
expression 


t) 
a) = fdg(@)p(%) dx. 


a 


The functions f(x) and g(x) of L}.,,(a,5) are said to be orthogonal with respect 
to the weight p{x) if (f, g)=0. 


Let o(x) be a non-decreasing function in [a, b]. Let us consider 
the functions f(x), for which the Stieltjes integral exists: 


iF S7(x) do(x). 
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> 
In this case | f(x) do(x) also exists. The set of such functions 


a 
will be denoted by L?,,.(a, b). 
There exists for any two functions f(x) and g(x) of Li o(a, 5): 


i ” feels) dotx) (4.16) 


and the corresponding Cauchy—Bunyakovskii inequality holds. 
Integral (4.16) is called the scalar (inner) product of functions f(x) and 
a(x) of L4.(a, b). 

The functions f(x) and g(x) are said to be orthogonal with respect 
to the integral weight o(x) if 


a= i} ” fode(x) do(x) = 0, 


i.e. their scalar product vanishes. 
In the case when o(x) has a finite number of growth points: x,, 
Xa, +++) Xp, integral (4.16) becomes the finite sum 


& Ade ad [oli +0)—o(8;— 0} 4.17) 


If all the jumps of o(x) are equal to I, i.e. 
a(x +0)—o(x,—0) = 1 
for all i, (4.17) becomes 


n 


Py Fxdg). (4.18) 


j= 


The orthogonality of f and g is influenced here only by their values 
at a finite number of points — the growth points of o(x). In this 
connection, the functions f and g can be regarded as specified only 
at these points (as in § 1, sec. 1). In this case (4.18) is the ordinary 
scalar product of the vectors f and g of E,(%, -.-, X,). The case 
when o(x) has a finite number of growth points is singular inasmuch 
as it is only in this case that there exist only m linearly independent 
mutually orthogonal functions (see § 1, sec. 1). 

The above concepts relating to the orthogonality of two functions 
are united by a common property: the inner product of the functions 
S(x) and g(x) is in each case equal to zero. The whole of our sub- 
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sequent discussion (unless there is a special proviso) will be independent 
of the particular method by which the concept of inner product 
is introduced. We shall thus use in general the symbol (f, g) to denote 
the inner product of f(x) and g(x), i.e. this symbol may be defined in 
any of the ways described. The case when 


ha= ie flag) dot). 


unites all the other definitions of scalar product. The case of a “differen- 
tial” weight p(x) is obtained from this when o(x) has an integrable 
derivative, and do(x) = p(x) dx, so that integral (4.16) becomes 


| ” paelx\olx) de. 


Orthogonality without a weight is the case when do(x) = dx. The 
orthogonality of functions defined at a finite number of points corres- 
ponds to a finite number of growth points of o(x). 

In future, we shall therefore use expression (4.16) for (f, g), where 
necessary. 


The scalar product of the function f(x) with f(x), i.e. (ff), is usually 


denoted by || f1|? and || 1] =/C6/S) is called the norm of the function. 
This quantity is the norm of f(x) in the corresponding normed space. 


The quantity 
fell = _| } ” (fa) dol) 


is called the root square deviation of functions f(x} and g(x). This 
is the measure in the accepted sense of the closeness of f(x) and g(x). 


2. Orthogonal systems of Bessel functions, Haar functions, etc. 


Let any two functions of the sequence 
a(x), Px), tees Prlx)s one, 


be orthogonal on (a, 5), i.e. (p;, )) = 0 if i # j. 
Such a sequence is described as an orthogonal system of functions 
on (a, 6). If the system of functions 


P(X), PolX), -+ +> Pa(X), --- 
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is orthogonal and each of the functions differs from zero, the system 
of functions 


els) __ ge) __ onl) 
2) = Teco? @ = Tecon? 7 = Tecan 


is also orthogonal. Every function of this system satisfies 


Ip) Il = VGp, Pi) = 1. (4.19) 


Such systems are extremely convenient. They are described as 
orthonormalized (or orthonormal). 
The orthogonal system 
G(X), P2(X), «+s Pr&X), + 


is said to-be complete in the space Bola, 5) if, among all the 
functions of L?2.,.(a, 5), there is none that is non-zero and orthogonal 
to all the functions of the system 


Gi(X), Pol), «++ Pa), --- 
ie, the fact that 


FC pa(%) do(x) = 0 


for all n, implies that 
f(y) =0 


(excluding possibly a set of measure zero). 

In the case of a finite number of growth points of o(x), a complete 
system contains as many functions as there are growth points of 
a(x). 

ExamPte 6. The system of functions 

sin x, sin 2x, ..., Sinmx,... (4.20) 
is orthogonal on (0, 2), since 
[sine sina =0 for msn. 
0 
The system is complete. 
EXAMPLE 7. The system of functions 


1, cosx, cos2x,..., cosmx,... (4.21) 
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is orthogonal on (0, 2), since 
tt 
| cosmxcosmxdx=0 for msn. 


Q 


The system is complete. 
EXAMPLE 8. The system of functions 


1, sin x, cos x, sin 2x, cos 2x, ..., sinmx, cosmx,... (4.22) 


is orthogonal on (0, 27), since 


20 

| sinmxcosnxdx = 0 for. any m and na, 
etd 

i sinmxsinaxdx=0 for mn, 


23 
i cosmxcosmxdx=0 for men 
(m= 0, 1, 2,...; a= 0, 1, 2,...). 


The system is complete. 
The system of Bessel functions. Let J,(x) be the Bessel function of 
order n, and A, 4,, ..., Aj ... the positive roots of the equation 


JA(x) = 0 


or of the equation 
Ji (x) = 0. 
The system of functions 


Tn(Are),  In(4ex),  In(Agx), ++, InAs --- (4.23) 
is now orthogonal in [0, 1] with respect to the weight x, since with 
iAP: 

I. F,(Ayx) I, (Agx)x dx = 0, 
0 


The system (4.23) is complete. 

The system of Haar functions. In recent times a use has been found 
for the orthogonal system of Haar functions. This system consists 
of piecewise constant functions (0), where 
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WO ay _ Ral 
0 
V2 
P(t) = = ie Jz 
0 
2 
PO = 
WP) = = os 
220 = | > 


Pas 

°c 

= 

S 

— 

u 

en eT 
I 
° ot oy 


- for +fé [0, 1]; 


1 
for re[o, z)’ 
1 
for re(p i], 


for t= 


for t€ [z z) > 
for t€ (= Z| > 
at other points; 

for f€ E 3) , 
for t€ (= z| 


at other points; 


(4.24) 
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4) = Ea spec ae (= | (4.24) 


0 at other points. 
In general, 
WO = VF MP =- VF 
2k-2 2k-1 

V2 for te[ Gear ar); 
yo) = a 2k-—1 2k 4.25 
2) ~/2 for (Far : ea |} (4.25) 

0 at other points [0, 1]. 

The Haar functions are generated from the “polygonal functions” 


of Schauder’s basis. The orthogonality of the Haar system follows 
from the fact that, given the same n, 


POO =O for jokzl, 
so that 
(AP, 4) = 0. 


Given different subscripts m and n, where m> n, and any j and k 
the sub-intervals, where x‘*)(1) # 0 are wholly contained in the intervals 
of constancy of y3(t) for m> n, and 


2k 
gmt [ym / 
I, UPD dt -i\r YP) dt = (2 QmFi ez ee )= 0, 


Qm+t 


where 4 is the value of 7@ on the interval of constancy. 

The system of Haar functions has an important approximation 
property: the Fourier series (see Chapter JJ) of any continuous function 
with respect to the Haar system is uniformly convergent to it in [0, 1]. 

The concept of orthogonality of functions of one variable on a 
segment may be generalized in a natural manner to functions of several 
variables, defined in some domain. __ 
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The functions f(P) and g(P) of a point P of n-dimensional space are 
said to be orthogonal with respect to a domain D of this space if 


{ S(P)g(P) dP = 0. (4.26) 
D 


A similar definition can be given of the orthogonality of f(P) and g(P) 
with respect to the weight k(P): 


| S(P)g(P)k(P) dP = 0. (4.27) 
D 


EXAMPLE 9. The problem of the vibrations of a plane clamped mem- 
brane leads to the differential equation 


AU+i{U = 0 


(where A is Laplace’s operator) with the boundary condition U = 0, 
The eigenfunctions of this equation, corresponding to different values 
of 4, are orthogonal: 


{ | Ue NUE Dendy =O 
G 


EXAMPLE 10. Let 9,(x), Go(x), . - » Pp(x),-.- beasystem of functions 
orthogonal on the segment [a, 5]. The system of functions 


Ui, 9) = HOMO) (4.28) 


is now orthogonal with respect to area on the square a= xs b, 
aZyzb. 


ak) 
For Pile O)PAGAMO) dx dy = 
aJja 
b b 
= | pucsdpns) dx { PIO) dy = 0, 
a a 
if either i + k or j # 1, ic. if U, x, y) and U, ,(x, y) are different 
functions of system (4.28). 


Systems of the form (4.28) are utilized, for example, in the expansion 
of the symmetric kernel of the integral equation 


9x) = af’ K(x, s)p(s) ds + f(x) (4.29) 


as a series in the eigenfunctions of the equation. 
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If {p{x)} is a normed system of eigenfunctions of (4.29), corres- 
ponding to the eigenvalues 1/4,, while {O,(x)} is asystem of eigenfunc- 
tions corresponding to the zero eigenvalue, the system of functions 
(where i and j are arbitrary): 


PLP), Ai)P{s).  P(*)O;(5), Ox)O;(s), (4.30) 


is orthogonal on the square (a = x = 6; aS 5 5 5b), since the system 
{p(x), 0,(x)} is orthogonal on {a, 3}. 

System (4.30) is complete in the space of functions square integrable 
on (@3x26; ass bd). Hence the square integrable function 
K(x, s) can be expanded as a series in this system. The Fourier coeffi- 
cients of the function K(x, s) with respect to the functions 9,(x)p,(s) 
for i # j, O{x)p,(s) and ¢{x)O,(s) vanish for any i and j, while with 
respect to the functions y{x)p,(s) they are equal to 1/4,, by virtue of 
the relationships 


} : i. Ktx, pols) de ds = { ” px) dx i ” Kx, spa) ds = 
= al "nade =0, f tH y 
b fd 'b b 
| | K(x, s}p(x)O,(s) dx ds = | 9;{x) ax K(x, 5)0,(s) ds = 0, 


[ li K(x, pols) de ds = [. gale) de { ” K(x, spe) ds = 


= = [ neyo) de = 
= > cle i aa i 


Hence Kes, 9) = FF wn. 

The concepts of orthogonality of functions with respect to surfaces 
and curves can be treated in the same way as the above orthogonality 
of functions in a domain D of n-dimensional space. For instance, the 
spherical Laplace functions are orthogonal with respect to the surface 
of a sphere. 
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3. Linear independence. The process of orthogonalization 


A system of n functions is said to be linearly independent if, given 
any system of n numerical factors, for which 


n Z 
I a> 0, 
t=1 


the function A,9,(x)+4.9,(x)+...+4,9,(x) is non-zero. If there 
exists a system of factors 2; such that 


AyPr() + AaG2(X) + «++ +AnPalX) = 0, (4.31) 


’ where at least one 4; differs from zero, the system of functions (x), 
G(x), «. «5 Pp(x) is said to be linearly dependent. (In the case of func- 
tions of La, 5), equation (4.31) can hold for a linearly independent 
system on a set of measure zero.) 

The concept of linear independence of functions is similar to the 
concept of linear independence of vectors of n-dimensional vector 
space (see Chapter II, § 1, sec. 4). 

Let the inner product (,,9,) be defined for any pair y,(x), (x) of 
the function system 9(x), 9(x),.... P, (x). 

In analogy with the Gram determinant for a vector system (see 
Chapter II, § 1, sec. 5), we introduce the determinant 


1, P) (Pr 2) «+» Gv Pr) 
Ay = | P% PD (Pas Fa) ++» ar Pn) | (4.32) 


ns P1) ns Fa) «++ Ons En) 


which is called the Gram determinant of the function system. 

Properties of the Gram determinant. 1°, The Gram determinant 
A, = 0 for any system of functions. 

2°. Let the system of function, 71, Yo, .. ., ¢, be defined on the seg- 
ment [a, 5] and let the interval (a,, b;) be contained in (a, b). 

Now, if 4, is the Gram determinant of the system in [a, 5] and 
(p;, ¢;) is defined by 


is %) = ik Gi(x)p,(x) do(x) 
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while A‘, is the Gram determinant of the same system in [a,, 5,], 


we have 
A, = 4}. 


This property also holds for the Gram determinant of functions of 
several variables in a domain Q: the Gram determinant can only 
diminish when the domain diminishes. 

THEOREM 2. The necessary and sufficient condition for a finite system 
of functions to be linearly independent is that its Gram determinant 
be different from zero. 

_ THEOREM 3. Every finite orthogonal system of functions is linearly 
independent. 

Theorem 3 is an obvious consequence of Theorem 2, since the 
Gram determinant of an orthogonal system of functions is equal to 
the product of the squares of the norms of all the functions of the 
system, each of which is greater than zero. 

An infinite sequence of functions 9,(x), ¢(x), ..., P(X), --- 
is said to be linearly independent if any finite sub-system of it is linearly 
independent. 

Given the system q, M2, ..., P, Of linearly independent functions 
and some function f(x), let us consider the problem of the best root 
square approximation of f(x) by means of linear combinations of 


n 
the system, i.e. from all the linear combinations ) d,p, we find the 


imi 
one that gives a minimum for the expression - 


f- ap; : 
for 


The coefficients of the best linear combination are found from the 
system of linear equations 


Q n 
=> a dj A 
Od, ( f pa 


EP, P+ (G2, M1) + --- thin PD) = CF Prd. | 
AYP, Po) +42, Pa) + - +» +4n@ns Po) = (fF Pa) (4.33) 


2 
)=o (k= 1,2,..., 7), 


ie. 


AP, Pn) + de(Pos Pn) + --- +4n(Pns Yn) = (4 Pn 
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The determinant of this system is the Gram determinant; in view 
of the linear independence of the initial system, it differs from zero 
and (4.33) has a unique solution. Obviously, it is easiest to find the 
coefficients d,, d,..., d, from (4.33) if the initial system is orthogonal. 
In this case (4.33) becomes the system 


Ars Px) = KPa) (k= 1, 2,..., 7). (4.34) 


By starting out from any (finite or infinite) linearly independent 
system of functions (or vectors), an orthogonal system can be formed, 
the elements of which are certain linear combinations of the elements 
of the initial system. Let us consider the process of forming such a 
system. It is called a Schmidt orthogonalization process. 

Suppose we are given the linearly independent system 


Pir Pas sees Pn eee - 
We put 
G(x) 
(x) = ———+,,- 
(, gy? 
Let 


Wz = Po(X)— Co,0,(x). 
The coefficient cp, can be chosen so that (y2, @,) = 0, by putting 


Ca = Pees a = (2, oy). 


Having chosen such a cp,, we put 
pel) 
w(x) = PR 
(Ya Pe ie 


Here (w,, p2) # 0, since otherwise (x) = 0, and this would mean 
that , and 9, are linearly dependent. 

Suppose that functions @,, w2,...,@,_, have already been found. 
We now put 


Pals) = als) —"F ener), 


here the numbers ¢,,, are chosen so that »,(x) is orthogonal to all the 
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functions @,(x), ..., @,_,(x). We must take for this: c,; = (My, ©). 
We next put @,(x) = p,(x)/(Pp Pn)”, Where (p,, Pp) ¥ 0 in view of 
the linear independence of the functions g,, ..., @az_,. This process 
can be continued indefinitely. 

The system ,(x), . . ., @,(x), . . . thus formed will be orthonormalized 

The process of orthogonalization of a vector system is precisely 
similar. 

In the case of a vector system in n-dimensional space, or of a system 
of functions defined at n points, such a system contains not more than 
n elements. 


4. Fourier coefficients, Closed systems 


Let 
(x), (x), ..., Ox), --. (4.35) 


be an orthonormal system of functions. Given a function f(x), suppose 
that its inner product exists with any function of the system. The 
numbers c, = (f, @,) are called the Fourier coefficients of f(x) with 
respect to system (4.35) In the particular case when (4.35) is a trigono- 
metric system, the c, are the familiar Fourier coefficients of the theory 
of Fourier series, 

The Fourier coefficients of functions are the analogues of the pro- 
jections of a vector on to the vectors of an orthonormal vector system. 
If all the Fourier coefficients of a function exist, we can formally 
construct the series 


 cqc,(2). (4.36) 
kel 


This series is called (in analogy with the corresponding series with 
respect to the trigonometric system) the Fourier series of f(x) with 
respect to the system (x), ..., @,(X),... - 

Bessel’s inequality and Parseval’s equation. We can write Bessel’s 
inequality for any f(x), for which (f, f) and all the Fourier coefficients 
exist: 


dally, (4.37) 


n 
i= 


ra 
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from which it follows that the series }’ c? is convergent and 


i= 
ey fess, f). (4.38) 
t= $ 
In the particular case when }\ c? = (ff), (4.38)isknownas Parseval's 
n=] 
equation. 
Let 


@,(x), (x), SO, o,(x), oe! (4.39) 


be an orthonormal system of functions on (a, 5), and f(x) a function 
defined on (a, b) for which (f, f) exists. 

When considering the problem of the best root square approximation 
of f(x) by the linear combinations 


nh 
a dn,(x), 
we arrived (see sec. 3 of this article) at an expression for the coefficients 
of orthogonal system {w,(x)} giving the best approximation (4.34): 


— fr) 
dh 7 (@,, Dr) : 


which yields in the case of a normed system: 
dy = (fy Oy) = cp. 
From this there follows: 


n 
THEOREM 4, Ofall the linear combinations ¥. dw (x), the finite Fourier 
sum te 


iy ,0,(x) 
ist 


has the least root square deviation from f(x) (i.e. the linear combination 
for which d, = ¢;). 

The orthonormal system w,(x),..., @,(x), ... is said to be closed 
if Parseval’s equation is satisfied 


F t= { ” $%(x) doe) (4.40) 
i=1 ri 
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for any function f(x) of L2,,.(a, 5). In this case, 
b 
FQ) dolx)— Yc =~ 0 as nm, 
a A i=1 


which implies, in view of the equation 
b n i) n 2 
| fx) do(x)— yo e =| [ f@) 2 conc do(x) 
a = a i= 


that the root square deviation 


7) n 2 
| [s0-% <0] da(x) (4.41) 
a ia 
tends to zero as n> ©, 

If (4.41) tends to zero as m + ©, we say that the Fourier series 


Xcode) 


is convergent in the mean to f(x). 

Consequently, if f(x) belongs to L2 (a, b), its Fourier series with 
respect to any closed system is convergent to it in the mean. 

EXAMPLE 11. The trigonometric system (4.22) is closed in (0, 27.) 

EXAMPLE 12. 

THEOREM 5 (V. A. Steklov). The set of eigenfunctions of the Sturm— 
Liouville equation forms a closed system. 

It was in the context of this theorem that V. A. Steklov introduced 
the concept of closure of a system. 

It follows from Parseval’s equation that every orthogonal system, 
closed in P2 (a,b), is complete, and every complete orthogonal system 
in L2..,(a, 5) is closed. 


‘o(x 


5. Fourier series in a trigonometric systemt 


The problem of representing an arbitrary function f(x) by a trigo- 
nometric series 


2 ae y (aq cos nx +b, sin nx) (4.42) 
rs 


+ See Chapter JII for more detailed information on trigonometric Fourier series. 
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arose in the middle of the eighteenth century in connection with the 
problem of the vibrations of a string. This problem occupied all the 
greatest mathematicians of this period. The essential step in the solu- 
tion of the problem was taken by Fourier, who establishedt that, by 
virtue of the orthogonality of the trigonometric system, the coefficient 
of series (4.42) can be expressed in the form: 


Saree 
a= Z| fede 

1 fam 
On = { Six) cos nx dx, (4.43) 

0 

1 2 
m=z F(x) sin nx dx 

rid i) 


(hence the name Fourier coefficients in the case of any orthogona- 
system). 

Fourier stated the theorem to the effect that a (graphically) arbitrary 
function can be represented by a Fourier series. 

Historically, the first theorem on the convergence of Fourier series 
was: 

THEOREM 6 (Dirichlet, 1829), Any function that admits of integration 
in any interval in (0, 2) and does not have an infinity of extrema in 
the interval can be expanded as a Fourier series, which is convergent at 
every point x to the value 


f(x +04+fx—0) 
caer Gere 


The crucial point in Dirichlet’s proof was the representation of 
the partial sum s,(x) of the Fourier series and of the remainder in 
the form of integrals: 


. 2n 
sin 


HO ea) 


sy) = 3 [" Eee ary &) de 
7 2 


+ This had been noticed before Fourier by Euler. 
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and 
._2n 
sin — — 


fla) —s,(2) = males (Fe) —f@)) 


together with the following observations: 


()if0< e< 5% then asn =, 


[90 ay # > F9O: 


sin B 


Qif0<b<cs 3" and (8) is monotonic, then 


i 9B) ———5— sin (2n+ NB dB ~ as n+ 0, 


~~ sinp 


A rather more general theorem may be proved by the same method. 
TuHeoreM 7. If f(x) is a function of bounded variation, its Fourier 


series is convergent at every point x to the value 5 [f(x+0)+f(x—-0)]. 


If, in addition, {(x) is continuous at every point of some interval, the 
Fourier series is uniformly convergent in the interval. 
THEOREM 8 (Lebesgue’s Test). Let 


P(t) = g(t) = flx + +flx—)—2f@) 


and 
he 
®,(H) =| Ipt)| de. 
AG) 
If 
P.M) 9 as h-+0O 
h 
and 


[OFT ae 0 as +0 


” t 


the Fourier series of f(x) is convergent to f(x) at the point x. 
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THEOREM 9 (Dini-Lipschitz). If f(x) is continuous and its modulus 
of continuity w(6) satisfies the condition 


o(8)in-+ +~0 as 6-0, 


the Fourier series of f(x) is uniformly convergent. 
THEOREM 10 (de la Vallée-Poussin). Jf the function 


1 ft 
w= [90 


ti) 


is of bounded variation in some interval with left-hand end point t = 0 
and x(t) + 0 as t + 0, the Fourier series of f(x) is convergent at the 
point x to the value f(x). 

THEOREM 11 (Hardy). if 


fath—fx) =0 [(» im) | 


and the coefficients c,, of the series have magnitudes of the order O(n~ %), 
where 6 = 0, the Fourier series is convergent at the point x to the value 
J (x) (see Chapter I, § 3, sec. 8 regarding the symbols o(n) and O(n)). 


6. Biorthogonal systems of functions 
A biorthogonal system of functions on (a, b) is a system consisting 
of two sequences 


Go), (x), G2{x), aes J Gn{X), aod } 
pals WO AOD ees WOE ses ee 


satisfying the following condition on (a, 5): 
(Pir 5) = 8335 
where 4,, is the Kronecker delta (see Chapter Il, § 1, sec. 2). Here, 
b t 
the inner product (p,, »,) is either { Hip; aX or f 9p; do(x). In 
a a 


the latter case we speak of a system of functions, biorthogonal with 
respect to the weight o(x) or p(x), if do(x) = p(x) dx. 

Given any function, for which the inner products encountered later 
exist, we can associate with it the series 
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fe) ~ ¥ Angled, (4.45) 
where deh ws 


and consider the question of the convergence of the series and the 

possibility of using segments of it for approximation to the function. 
EXAMPLE 13. Chebyshev’s biorthogonal system on (—1, 1) with res- 

pect to the weight p(x) = 1 is 

sin(k+ lop 


a(x) = sign 2 


in (4.46) 
v(x) = i x w@) dT 
™ 2 afi @ sin p 
where x = cos p (k= 0, 1, 2, ...), 


> 


while d in (4.46) runs over all odd divisors of k+1, including d= 1 
and d=k+1 if this is odd; the function sign x was introduced in 
Chapter I, § 2, sec. 1; u(d) is the Mobius function, i.e. 

Hl) = 1; 

u(a) = 0, if a is divisible by a square different from unity; 

“(a) = (—1)’, if a is not divisible by a square different from unity, 

and r is the number of prime divisors of a differing from 1. 

The functions p,(k) of this system are piecewise constant, while 
p,(x) are polynomials in x having k simple zeros in (—1, +1). The 
first few functions of this system are given below: 


P= 1, Yo= > 


-1 for -l<x<0O, 
+1 for O<x<I, 


-1 for -Il<x< ~—-<+, 
1 1 ] 
p(x) =4 +1 for -z<*<5, yx) = 2(8-5), 


—1 = for aax<d 
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“ 1 
~~ in (- -=5); 
“ ] 
pas) 
Yo(X) = ; 1 
-1 in (0), 


+1 


p(x) = 2x(2x?— 1). 


B 
os 
sl 
al 


EXAMPLE 14. Markov’s biorthogonal system in (—1, +1) with respect 


to the weight p(x) = 1/1—x? is 


Po = 1, Y= 
(4.47) 


®, = Signcoskp, yp = 
where x = cos g, d in (4.47) runs over all add divisors of the number 
& that do not contain square factors, and h is the number of prime 
factors of the form 4m-+1 contained in d (mm # 0) (see Chapter I, 
§ 2, sec. 1, regarding the function sign x). 

Here, as in the Chebyshev system, »,(x) are piecewise constant, 
while y,(x) are polynomials in x. The first few functions of this system 
are given below: 


] 
Po = 1, Yo = x’ 
_f -1 in (-1, 0) _x 
xX) = { #1 Fn ©: 1) v(x) = 7? 
+1 in (- ~~z): 
2 
~1 in east): Gye DL besh 
2{x) = 5) ’ 0 ’ P2 =a 2 > 
f 1 
+1 in ( 1), 
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2 > 

Series in Chebyshev and Markov functions are similar to series in 
sines only or in cosines only. 

On passing from polynomials and the interval (—1, +1) to tri- 
gonometric sums and the interval (—z, +7), we can combine both 
systems into one, which generates series corresponding to trigono- 
metric series of a general type. 

A biorthogonal system is called a Chebyshev—Markov system with 
respect to the weight o(x), if ~,(x) is a polynomial of degree k, and 


pr(x) = sign Q,(x), 
where Q,(x) is a polynomial of degree k. 

THEOREM 12. The biorthogonal Chebyshev-Markov system for a 
given function o(x) is unique; the polynomial Q,(x) appearing in the 
expression for ,{x) is the polynomial of degree k with first coefficient 
1 for which 


f. | Ox(x) | dot) = min |" | Pa(x) | do(). 
ay Pax) } 4 


The system of polynomials y,(x) is determined after this by means 
of a process similar to the Schmidt orthogonalization process (the 
metric of space L},..) is the natural one when considering series in the 
Chebyshev—Markov system). 


+1 in (2 t), 


§ 3. Orthogonal systems of polynomials 


Various systems of orthogonal polynomials were introduced by 
Legendre, Jacobi, Chebyshev and other mathematicians The first of 
these historically was the system of Legendre polynomials. Chebyshev’s 
studies laid the foundations of the general theory of systems of ortho- 
gonal polynomials. 
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Let the system 
P(x), Py(x), .... Pax), ..- (4.48) 
where P,(x) is a polynomial of degree n, be orthogonal on (a, 5) 
(in particular, the interval may be infinite) in the sense that 
2) 
Pm Pa) = | Pry (x) Pp (x) do(x), (4.49) 
a 
where o(x) has an infinite number of growth points (in particular 
do (x)= p(x)dx, where p(x) is integrable in (a, 6)). Apart from a constant 
factor in the polynomials, the system (4.48) can be obtained by means 
of orthogonalization (see § 2, sec. 3) of the system of functions: 1, 
X %_,...x",... Let us agree to write P(x) in future for polynomials 
of orthogonal system (4.48) defined by the condition that their first 
coefficient is equal to 1: 


P(x) = 1, Py(x) = x+ayo, .-- 


pe (4.50) 
ceey PalX) = XP 4.4q, narX" 14+ 0. tan» 
and P,(x) for polynomials of the orthonormal system, i.e. 
Db . 
| P2(x) do(x) = 1. (4.51) 
a 


The Fourier coefficients of f(x) in an expansion in polynomials 
{P,,(x)} have the form 


Qs [ ” AC)P, (x) dolx). 
Tn particular, if do(x) = G(x) dx, we have 
—_ { "GP (xd de, gl) =fONG). (4.52) 


Notice, that, to evaluate integral (4.52), it is not necessary to find the 
values of P,(x) throughout the interval. On writing 
gx) = *o2)d— and for ims gM) = * pl-iF0(8) aE, 
a a 
we obtain, by integration by parts, 
Cm = PD(B)P,, (B)— GI P(D)Py () + 0 (= 1 PE)PPO). 
Therefore, to find the coefficients cy, ¢, . . ., Cm» We only need to find, 
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by successive integration of ¢(x), the values of y—-(), o'—(b), ..., 
g'-™ (8), the values of the polynomials P,(x) (k = 1, 2,...,m), and 
their m derivatives (for k = 0, 1,..., m) at the point b. 


1. Zeros of orthogonal polynomials 


THEOREM 13. The n-th degree polynomial P(x) of the orthogonal 
system (4.48) has n real distinct simple roots, all of which lie in (a, b). 

THEOREM 14. The zeros of the polynomials P,(x) and P,_,(x) of 
system (4.48) alternate: between any two zeros of P,(x) there is a zero 
Of Py (*)- 

It follows from Theorem 14 that P,,(x) and P,_,(x) have no common 
ZETOS. 

THEOREM 15. If A(x) is the number of changes of sign in the series 
P(x), P(x), .- 5 Pa(x), the number of roots of the polynomial P(x) 
in the interval (a, B) is equal to the difference i(a)—A(B) (the property of 
so-called Sturm systems). 


2. Recurrence relations for orthogonal polynomials 


Let P, +2); Py 41), P(x) be any three successive polynomials of 
system (4.48), satisfying condition (4.50). In this case the following 
relationship holds: 


Pra (X) = (%¥—n42)Pn41(%)— AnarPn (2), (4.53) 


where the parameters «,,, and A,,, are given by: 
be 
PRs 1(x) do(x) 
a - 


onp2 = aE _ 
i Pa, 0) dot) 

a (4.54) 

| Ba (2) dol) 


Aner = pasa a ee 
i P(x) do(x) 


a 


Obviously, 4,,, > 0. 
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The parameters «,,, 5, 4,,, are expressiblein terms of the coefficients 
of polynomials P,49, Pay Py: If 


= Rr=1 7 
P(x) = x*+ YS agzxi, 
j=0 
then 
On+2 = Angi, n— Into, n4p 


Ang = On41, n-1— Sn 28n ai, a Ina, 


It follows from formulae (4.54) that, if (a2, b) is a finite interval, 
we have for ali n: 


where 
A< Gig <b, | 
0 < angi < Cc, (4.55) 
where c? = max (jal, |4[). | 


For examples of such recurrence relations see § 4, sec. 5-10. 


3. Power moments. The expression of orthogonal polynomials in 
terms of power moments 


The numbers 
b 
bn = i x dol) (4.56) 
a 


are called the power moments of the weight o(x). 
In the case of the system 


|e en, corre 


the pair-wise inner products are expressible in terms of the power 
moments: 


b 
(em, 28) = [ 2x" dol) = Hmm: 
a 


Gram’s determinant of the system of powers is , 


Bie lah freatay Sates #0. (4.57) 
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The process of orthogonalization of a system of powers yields the 
expression for the polynomials P,(x) of (4.51): 


~ 1 
BG) = =| Un x |, (4.58) 
* AAG oa naye (ad Sesided a aokasats 
Un Mati +++ Man-1 x 
and for the polynomials P(x) of (4.50): 
i Co ae | 
SC) iO pee na (4.59) 
oo as a rr er es 
Un +++ Panar x" 


The parameters « and A of the recurrence relation (4.53) can also be 
expressed in terms of the power moments: 


Ho see Ba Un+2 
u By +++ Bntt Bn43 | 


Bo +++ Hn-1 0 Maen 
1 By +++ bn Pn+2 ; (4.60) 


Be nok sve apis ce eas 
Hnoee+ Hon-1 Hans1 
where n = 0, I, 2,...; 
fae 4nz14n— 
ie ae tne Sg (2 = 0, 1, 2, ...), 

while 4_, = 1. 
4. The connection between orthogonal polynomials and continued 

fractions 

The fraction 


P,(Q)—Pr() 
t-—x 


202 MATHEMATICAL ANALYSIS 


is asymmetric polynomial of degree n— 1 in ¢ and x. Hence the function 
eo & 
Ruy } Pa Fr date) (4.61) 
a = 


is a polynomial of degree n—1 in x. 

The polynomials R,,, ,(x), R,(x) and R,,_,(x) satisfy the same recurr- 
ence relation (4.53) as polynomials Paaa(*)> Pra s(%)s P, (x). This 
fact indicates (see Chapter V) that R,_,(x) and P,(x) are respectively 
the numerator and denominator of the mth order convergent of a 
Chebyshev type continued fraction: 


Io Ay i 
oO eh eg op 
X—&, X—A XO 43 


(4.62) 


The polynomials R,_,(x) are described as polynomials of the second 
kind with respect to the weight o(x). They are the denominators of 
the continued fraction 


Fic. Sea Se ee Sea ee (4.63) 
XO | X—Oy X—Onay 


and are orthogonal with respect to some other weight. 

If the interval (a, b) is finite, the sequence RP of conver- 
gents of the continued fraction (4.62) is convergent for all x lying 
outside (a, b) to the value of the integral 


{ neat) (4.64) 


ax? 


When the interval (a, b) is infinite, the continued fraction (4.62) 
is not always convergent. The question of its convergence is related 
to the determination of the corresponding problem of moments. 

Regardless of the convergence, the continued fraction (4.62) is 
related to the integral (4.64) by the following property: the expansion 
of the convergent R,-1()/Pal() of (4 62) as a series in negative po- 
wers of x coincides as far as terms of the order 1/x*" (inclusive) with 
the series 


Ho, Hh 


- Bette. ona, Man (4,65) 


xm xenti 
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which can be obtained if the function 1/(x—1) in the integral (4.63) 
is expanded as a series in powers of 1/x and formally integrated term 
by term (the convergence of series (4.65) is of no consequence). 

A continued fraction of the Chebyshev type, possessing the above 
property, is described as associated (assoziierte, Perron, ref. 11) with 
the series (4.65). 

In the case o(x) = const, the continued fraction (4.62) can be trans- 
formed, for x < 0, into a continued fraction of the Stieltjes type 


1 1 1 1 

GyX + Gy + GX + Oy + 
such that the mth convergent of (4.62) coincides with the 2nth conver- 
gent of (4.66). In view of this, the expansion as a series in negative 
powers of x of the 2nth convergent of the fraction (4.66) coincides 
with series (4.65) up to and including the terms 1/x™", A fraction 
of the Stieltjes type, possessing this property with respect to the series 
(4.65), is described as corresponding to it (correspondierende, Perron, 
tef. 11). We know from the theory of continued fractions that every 
continued fraction of the Stieltjes type (with a, 0) has a correspond- 
ing series, and every continued fraction of the Chebyshev type has 
an associated series. 

The converse problem is of great importance in analysis: transfor- 
mation of a previously assigned series in negative powers of x into a 
corresponding or associated continued fraction, yielding rational 
approximations for the function given by the series. 

Notevery previously assigned series has a corresponding or an asso- 
ciated continued fraction. A series possessing this property is described 
as seminormal. 

THEOREM 16. The series 


(4.66) 


fo en 
ett teqite 


is seminormal if and only if all the determinants 


Co Cy i Cyn, Cy Ch. ke Oped 
_ te. Cc. c. =)¢ Cys ¢, 
Pn = 1 2 ne and Yn = 2 Ki n 
Cn-1 Cn +++ Cong Cnt Cn v++ Cong 


are non-zero, 
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In this case, the coefficients of continued fraction (4.66) corres- 
ponding to this series are expressed in terms of ¢,, and ,, as follows 


~ — _ Pea Py-1 Pv41Pv 
Q= Py Ay = A, yg = 


PPy Pre Py ' 
where », = 1, y, = 1. 
The fraction (4.66) corresponding to the series can be transformed 
by a contraction (see Chapter V, § 1, sec. 3) into an associated fraction. 


5. The conversion of orthogonal expansions into a sequence of 
approximating fractions 


A problem can be posed similar to that of converting the series 
fo Sy fn 
stytyte tgHt. 


into a continued fraction 


pe ae 
OyX + Og HQgX+ 0005 


namely, conversion of the series 
RO) = 2 CpOn(*)s (4.67) 


where {w,(x)} is a system of functions orthogonal with respect to 
some weight in (a, 5), into a sequence of rational fractions of the form 


“} () 
a,00,(x 
EA) 5 ctv (4.68) 
nix) {#] 


> detox) 
& 


Here, in analogy with the conversion of power series into continued 
fractions the numbers a, and b, are chosen so that the first n+ 1 terms 
of the expansion of the fraction (4.68) in an orthogonal system {w,(x)} 
coincide with the same terms in the series (4.67). The fraction (4.68) 
will also be termed in this case the n-th convergent. 
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The problem of finding such a convergent is not solvable in the 
general case. However, the problem has a solution for certain systems 
namely those satisfying the relationship 


p(X) (x) = Ap@n 1%) + Baop(x) + C00; 10). (4.69) 


Numerous orthogonal systems satisfy (4.69), including in particular 
all orthogonal systems of polynomials, the system of trigonometric 
functions {cos nx}, of Bessel functions {/,(x)}, and so on. 

The formal process of converting the series (4.67) into the fraction 
(4.68) can be accomplished for these systems as follows. The fraction 
(4.68) is sought as the nth convergent of a continued fraction of the 
form 

Sq _ Oy (X) +m O(X)+% w(x) +05 . (4.70) 
L+Po+y+ Ye +Poa(X)+y3t+... 


The requirement that the series (4.67) and the fraction (4.68) corres- 


pond can now be written as 


Pr (X)— Gn(x) Ss CaOn(X) = TP Ong x) + AP an sa(X) tee. 4.71) 


Comparison of the coefficients of like functions w,(x), ..., @,(x) 
in (4.71) leads to the following expressions for the coefficients «,, B,, 
¥% @=1,..., 2) of continued fraction (4.70): 


AMC _ 
H=1 A=n=0 w= BR, Ye = TS 


amp 
By x Gee Bana Fa PCa + nea” 
: ae? , 
aig = — SEE Cnr FA Bn + a Anns Bad + Yad 
da-v 


(4.72) 
using these, we can find P,(x) and q,(x) from the recurrence relations 


Pp (x) = &pPa_1(x) + [O(X) + BalPn—2) + YnPn—al); 


4, 
dn) = Onn a2) + [004(2) + Buln 22) + Pana x ss 
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where we have put 


g2= 0 ¢.1=9, Go = 1, a(x) = 1, 
P,»~=0, Py»~=CQ, Py=Cy, P(x) = Co + Cya,(x) 


(here, A,, B,, C,, are the coefficients of relationship (4.69). 

To obtain rational approximations of sufficiently rapid convergence 
by this method, an effective approach is often to employ expansions 
in an orthogonal system of Chebyshev polynomials of the first kind 
(see § 4, sec. 7). 


6. Orthogonal polynomials and quadrature formulae of the 
Gaussian type 


The formula 
i} " fs) dota) = Fe AACA) (4.74) 
a =I 


for approximate evaluation of the definite integral is called a quad- 
rature formula of the Gaussian type if the base-points x (i = 1, 
..., ”) and coefficients A™ (i = 1, 2, ..., m) are chosen so that 
(4.74) is accurate when f(x) is any polynomial of degree not exceed- 
ing 2n—1. 

THEOREM 17. If (4.74) is a quadrature formula of the Gaussian type, 
accurate for polynomials of degree not exceeding 2n—1, its base-points 


xf, x6, ht 


are the n roots of the polynomial P,(x) of the system of polynomials 
orthogonal in (a, b) with respect to the weight o(x), while the coeffi- 
cients A\™ are the coefficients in the expansion of the n-th convergent 
R,_,(x)/P,(x) of the continued fraction (4.62) into a sum of simple 
fractions 

Rn) = a Ae 1 


P,(x) Ho xpxm’ 
Le. 
AQ” we Re= 1G) (4.75) 


P(x) 
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Alternatively, (4-75) can be written as 


ap = [ Pal dete) 
a(t—x{)P,(t) 


In the particular case do(x) = dx and [a, b] = [0, 1], (4.74) is 
the ordinary Gaussian quadrature formula, the base-points of which 
are the roots of the Legendre polynomial of degree n. 


7, The closure of an orthogonal system of polynomials 


The necessary and sufficient condition for closure of a system of 
polynomials {P,(x)}, orthogonal in (a, b) with respect to the weight 
o(x) in the space LB 4, 5), is that the problem of moments for 
the sequence of moments of the weight o(x) be determinate or that 
a(x) be its extremal solution (see ref. 7). 

The problem of moments for a finite segment [a, 5] is always 
determinate, so that orthogonal systems of polynomials with respect 
to any weight on a finite segment are closed. In particular, the sys- 
tems of Legendre, Chebyshev and Jacobi polynomials are closed 
(see § 4). 

The problems of moments are determinate for the Laguerre weight 
(see § 4, sec. 9) on (0, +0), and for the Hermite weight (see § 4, 
sec. 4) on (—<0, +09), i.e. these systems of polynomials are closed. 

Hence the Fourier series in orthogona! polynomials of a function 
S(x) of D3) are convergent in the mean to this function in the case 
of ali the classical weights. 

A discussion of the convergence of series in orthogonal polynomials 
{P,(x)} at every point and of the uniform convergence requires 
asymptotic estimates of | P,(x)| as n + o. 


8. Christoffel’s formula. The convergence of Fourier series in 
orthogonal polynomials 


Let {P,(x)} be an orthonormal system of polynomials in (a, b) 
with respect to the weight o(x), and let f(x) be any function of the 
space L}.(a, 5). 
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Let us write s, for the nth partial sum of the Fourier series of 
J(x) with respect to the system {P,(x)}: 


iG) = ¥ CyP(). (4.76) 


If we make use of the expressions for the Fourier coefficients, 
S,(x) can be written as 


sxe) = [0( 5, FaOPAC)) ao. (4.7) 
The expression : 
Kt, x) = PONG) (4.78) 


is called the kernel of the integral (4.77). The following formula holds 
for the kernel: 
Ras Vie n1(t)Pn(X)— Prat Palt) , (4.79) 


1 
Bg t—x 


where 4,,,, is given by (4.54). Formula (4.79), obtained by Christoffel 
forthe casea = —1,b = +1, do(x) = dx, and generalized by Darboux 
to the case of any weight, is known as the Christoffel-Darboux 
Jormula. 

Formula (4.77) and the relationship 


[ : K,(t, x) do(x) = 1 


a 


lead to a formula for the remainder of the Fourier series of f(x) 
in the system {P,,(x)}: 


'b 
Sn)—-f) = JInay i me) [ProiQPn(x)— Png Pn(f)] doce), 
(4.80) 
where 


oy = 20222 


t— 


The next two theorems, on the convergence of the Fourier series 
of f(x), follow from (4.80). 
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THEOREM 18. If ail the polynomials P,(x) are bounded at the point 
x and the function p,{t) belongs to Ly (a, b), the Fourier series 


¥ CPx) 
hed 


is convergent at x and 
fe) = CaP al). 


DEFINITION. The sequence of functions (x), 92(x), ..., 9,(X), 

. is said to be uniformly bounded if there exists a constant M such 
that | p,(x)|< M for all the functions of the system. 

THEOREM 19. If the polynomials P,{x) are uniformly bounded on 
(a, b), given any function f(x), integrable on (a, b) with respect to 
the weight o(x), its Fourier series in the system {P,(x)} is convergent 
to the value f(x) at every point x for which 


| ” eft) dot) 


exists. 

The following theorems establish the convergence of the Fourier 
series of f(x) in an orthogonal system of polynomials {P,(x)}, having 
regard to the structural properties of f(x) instead of the properties 
of the system. 

THEOREM 20. If f(x) satisfies the Lipschitz condition with index 


g>—, 
|fG2)—fGy| <= Mix,— 2x1!" 


then the Fourier series of f(x) in a system of orthogonal polynomials 
{P,,(x)} is convergent almost everywhere on (a, 5). 


b 
DEFINITION. The function L,(x) -| | K,(t, x)| do(t) is known 
a 
as the Lebesque function of the orthonormal system {P,{x)}. 


THEOREM 21, Let f(x) be continuous and let its best approximation 
by polynomials of degree n 


E,(f) = inf max |f(x)— n(x)! 


Qu(x) (a, ) 
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satisfy the relationship 
Lj(%o)- En(f) > 0 as n+ co, 


Then the Fourier series of f(x) in the orthogonal system {P,(x)} is 
convergent, at X = Xq, to the value f(xy). 


§ 4. Classical systems of orthogonal polynomials 


1. Pearson’s differential equation 


The equation 


a ed Masako bad _ 2(x) 
0” Bot Bet Bt (- 303) oe 


is known as Pearson’s equation. Solutions of the equation are called 
Pearson functions. The equation was introduced by Pearson for rep- 


resenting empirical laws of distribution. When «, = —1, a =0, 
1 

s 2 - = ~>5 xt 
Bo = 1, 8, = B. = 0, the solution is the classical function e ? 


— the density of a normal distribution law. 

The weights of all the most important systems of orthogonal poly- 
nomials are Pearson functions, 

Jacobi’s weight is | 


o(x) = (1~ x*(14+2)4, (4.82) 


where 4 > —1, w > —1; o(x) is defined on [—1, 1] and all its 
moments exist there. Pearson’s equation for Jacobi’s weight is 


(u-D-(+Ax 


a (4.83) 


ge = 
2 
Chebyshey’s weight is a particular case of that of Jacobi, corres- 
1 


1 
ponding tod = =p HEF; 


(4.84) 


a(x) = = 


I-x 
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Pearson’s differential equation for Chebyshev’s weight is 


, 


2 x 


ah ee (4.85) 
Legendre’s weight o(x) == 1 is a particular case of that of Jacobi, 
corresponding to 4 =0, u = 0, Pearson’s equation for it is 
g I 


tice (4.86) 


Any Pearson function, having all moments, and for which the 
denominator A(x) in (4.81) has real distinct roots, is reducible to any 
of the above functions by means of a linear change of the independ- 
ent variable. 

When the denominator B(x) has multiple or complex roots, the 
Pearson functions may not be weights of an orthogonal system of 
polynomials, since not all moments exist on the interval on which 
they are defined. 

The Chebyshev-Laguerre weight: 

o(x) = xe, where A> ~—1, u>0, (4.87) 
is defined on (0, + oo), Pearson’s equation for the Chebyshev—Laguerre 
weight is 
A- 4 

x 


R 


Ou, 
al (4.88) 
Any Pearson function, having all moments on (0, + -), for which 
the denominator f(x) in (4.81) is a polynomial of the first degree 
(By = 0), is reducible to this function by means of a linear change 
of the independent variable. 
The Chebyshev—Hermite weight: 


a(x) = e™ (4.89) 


is defined on (—~, +), Pearson’s equation becomes 


£ = —2x, 
4 
Any Pearson function, having all moments on (—, +), for 


which B(x) = const. in (4.81) (8; = 8, = 0), is reducible to a Cheby- 
shev-Hermite function. 


, 
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Thus all the Pearson functions that can serve as weights of an 
orthogonal system of polynomials are reducible to one of the above 
basic weights. 


2. The differential equations for corresponding’ classes of 
orthogonal polynomials 


The polynomials of orthogonal systems whose weights are Pearson 
functions satisfy linear differential equations of the second order, 
to which various physica] problems often reduce — a fact that ensures 
their importance in applied mathematics. 

If the weight g(x) of an orthogonal system of polynomials satis- 
fies 

g = Bg tax 
@ Bot Ayx+ Bx?’ 


then the nth degree polynomial of this system satisfies the differen- 
tial equation 


B(x)y” + [a(x) + B’@)y’ — yay = 0, (4.90) 


where y, = n[a,+(n+1)f,], and a(x), B(x) are as in (4.81). 
ExaMPLe 15. For Chebyshev’s weight, 


a(x) = x, a=, 
Bx) =1-2+4, B= -1. 

The equation for Chebyshev polynomials is of the form 
(1—2?)y"— xy’ + ny = 0. 


3. The expression, by means of the weight, of a polynomial of the 
nth degree belonging to an orthogonal system of polynomials 


Let us consider an orthogonal polynomial system with Pearson’s 
weight o(x) from (4.81). Let P(x) be the mth degree polynomial of 
the system, orthogonal with respect to the weight function (x). 
We can write P,(x) in the form 


Py (3) = Anas Fa (Od). 4.91 
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The formula was obtained by Rodrigues for Legendre polynomials 
(in 1814), while similar formulae were later obtained for other poly- 
nomials. Rodrigues’ formula was first published in the general 
form (4.91) in ref. 5. 

If A, = 1, the coefficient of the highest term in P,,(x) is 


an 
= [] @a+kbs)s (4,92) 
k=n+1 
while for x"~" it is 
v _ % bnB, 3 
b, = a Son + nb, Nay, (4.93) 


The coefficient of the highest term in the normalized polynomial 


is 
Fa eee (4.94) 
n! i} ax) B(x) dx 


4. The generating function of an orthogonal system of 
polynomials with Pearson’s weight 


Let us take an orthogonal polynomial system {P,,(x)}, where P,(x) 
is defined by (4.91) with constant 4, = 1. 

The generating function of the system is the function »(z, w) of two 
complex variables z and w such that 


ie, wim S Pale) wh, (4.95) 


THEOREM 22. Given any orthogonal system of polynomials {P,(x)} 
with weight function 0(x), satisfying condition (4.81), there exists a 
generating function (4.95), which is given by 


1 _ ow) 

o(z) 1—wA'(Ew) ’ 

where &,, is the root of the quadratic equation 
£-z—wB() = 0 (4.97) 


that is close to z for small w. 


pz, w) = (4.96) 
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EXAMPLE 16. Let us find the generating function for the Legendre 
polynomials. 
Equation (4.97) becomes in this case 


we 1 E~(z+w) = 0, 
where 


by = xe (—14 VT rane Foe) 


is chosen in such a way that &,, is close to z for small w, i.e. 


1 
acuta euler ayer aye): 
by = yo (—1+ 1+ 4wz + 404) 


On applying formula (4.96) and putting o(x) = 1, we get 
1 


Zz, ¥~) = ———————— | 
vem) V¥1+4wz+4n? 


The derivatives of polynomials orthogonal with respect to Pearson’s 
weight are also orthogonal polynomials with respect to the weight 


o(x) = exp | | a 


(4.98) 


5. Legendre polynomials 


The first system of orthogonal polynomials was historically the 
system of polynomials with the weight function e(x) = 1 on [—1, 
+1], introduced by Legendre in 1785. 

We introduce the following notation: let L(x) be the Legendre 
polynomial, in which we have not fixed the factor, to an accuracy 
of which the system of orthogonal polynomials is defined, let L,(x) 
be the mth degree polynomial with highest coefficient equal to 1, 
and let L(x) be the normalized Legendre polynomial. 

Rodrigues’ formula is 

a0? — 1)" 


= (4.99) 


L(x) = A 
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Formulae (4.92)-(4.94) lead to the oon for L(x) and L(x: 


Te) = gay Geet (4.100) 
PS 2n+1 1 
Ly) = = 2 Gayit at aT iss 1". (4.101) 
The explicit expression for a Legendre polynomial is 
[2] 
L(x) = Aq om e 1p ear Ob nah, (4.102) 


It follows from (4.102) that L,(x) is an even function in x when n 
is even, and odd when n is odd. 
A recurrence formula. For the Legendre polynomials, we have 
in (4.54): 
y _ +1)? 
“aes 0 Most = Birk Ons)" 


Lao) = xEq4 12) - aa Ent). (4.103) 


(2n+1)(2n+3 
Obviously, L(x) = 1, L(x) =x; we further obtain from (4.103): 


Tye) = $ Gx" 0, 
Iya) = 5 (59-32), 
Lx) = 5 (35x4— 30x? +3), 


L,(x) = =; (315x5— 350x3+75x) and so on. 


i 
The continued fraction (4.62) for a Legendre polynomial becomes 
es +19 
Ee ee Cl) Coc) 
Per Tee x x 


The denominator of the nth convergent of (4.104) is L, (x). 
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The continued fraction (4.104) is convergent to In(x+1)/(x-1) 
at every point x lying outside [—1, +1]. 

The generating function. Let H(x, w)'be the generating function of 
the Legendre polynomials (4.95); (4.98) now gives 


1 


H(x, ¥) =~ , 4.105 
ce Jl $4wx +42 ( ) 
and 
1 - 5 Ee) EA) in 
J1+4wx+4v? nko nt! 
where 
2.0) = 08-1" 
XPS As 
or 


Hx, w) = 1—2xw+2(3x2- Dw? — 4(528— 3x) + 
+2(35x!— 30x? +. 3)wt+ 


The generating function of the Legendre polynomials is often 
written in the form 


1 
A(x, t) = ———-.,_ where = —2w, 
Jf1—2xt+ 2? 
so that 
<i Daa =< hOt*, 


where /,(x) is given by (4.99) with A, = If(2k)h. 
The polynomials L,(x) and L,(x) are expressed as follows in terms 
of 1,(x): 


Z,) = pat In(x); 


2.) = ‘a, 


The polynomials /,() satisfy the recurrence formula 


(8+ 2Dlneo(x) = (21 + 3)xl (xX) — (t+ Dip). (4.107) 


(4.106) 


I,(x). 
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The differential equation for Legendre polynomials is 
(1—>?)y" ~ 2xy’+a(n + Dy = 0. 


The integral form of Legendre polynomials. The polynomial 
1 d®@ n 
1) = Gnit Ga 1) 
can be written in the form 


I,(x) = if (x +iJ/1— x? cos 9)" dp (4.108) 


The integral in (4-108) is known as a Laplace integral (it has a real 
value for real x, in spite of the integrand being complex). The poly- 
nomials /,(x) are uniformly bounded on the segment of orthogonality 
[~1, +1]. 

It follows from (4.108) that 


lA()| 31 (4.109) 
for 
Ixpal 


A stricter inequality holds for points lying inside the interval 


(-1, +1): 
[x 1 
jE(x) | mn Vi-e (4.110) 


Turan’s inequality is 
B(x) —hh-1 Mla) = 0 


forn21, -lsxel. 
The following are expansions of certain functions in Legendre 
polynomials: 


1 


OM a, 
oad 


A(x) + 
2n(2n— 2)... (2n—2k +2) 


+ G+) Gag ipa. Garza Ty 6 
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xentl me 3 Lx) + 
z 2n(2n— 2)... (2n—2k +2) 
“i Gk +3) GT 3 ina 3). One ak ay Be 
| 


ims 
= 
+ 


{ano Wha), lal 


= Qk-DNQK+ DU 
2, Get 3) BARI (EAD! 


“a 
bray 


‘aei@), [x[ <1. 


44 
a 


oe vis wots 


= 2k—3)!! 2k— 1! 
313 - > a) ee ints), 
Ix|<1, 


. m 2 ((2k—1)!!\? 
arcsin x = 5 (Sa) Toni) — har), [x] <1. 


The convergence of Fourier series in Legendre polynomials. 

THEOREM 23. If f(x) has a continuous second derivative in [—1, +1], 
it can be expanded as a uniformly convergent series in Legendre poly- 
nomials in [~1, +1]. 

By (4.106) and (4.109), we have the following inequality for nor- 
malized Legendre polynomials: 


noi = A for vei’: (4.111) 


Formula (4.111) and the corresponding inequality for the kernel 


K,(t, x) of L(x) give an inequality for the Lebesgue function (see 
§ 3, sec. 8): 


L,(x) = (2+ 1). (4.112) 
A consequence of Theorem 21 (see § 3, sec, 8) and (4.112) is: 
THEOREM 24, Every continuous function f(x), the best approximation 
of which satisfies the condition 


lim 77E,(f) = 0 (4.113) 


can be expanded as a uniformly convergent series in [—1, +1] in 
Legendre polynomials. 

The following is a consequence of Theorem 23 and formulae (4.106) 
and (4.110): 
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THEOREM 25. A function f(x), the square of which is integrable in 
[-1, 1], can be expanded as a Fourier series in Legendre polynomials 
convergent to f(x) at every point x for which the integral exists: 


f(2eBya any 
25 t—x : 


REMARK. Condition (4.114) is satisfied, in particular, if the finite 
derivative f’(x) exists at the point x. 

THEOREM 26. Let f(x) be a function, the square of which is integrable 
in [~1, 1], and suppose the left- and right-hand limits f(x—0) and 
S(x—9) exist at the point x In this case, if the integrals 


i See > a ( (Seva 
-1 


are finite, the Fourier series in Legendre polynomials is convergent 
at the point x tox [f~—-0)+/(x+0)] 
THEOREM 27. If f(x) satisfies the Dini-Lipschitz condition in [-1, 
+1): 
lim (6) In (6) = 0 
$0 


(where w(6)= sup {|f(x)—Cf%,)|} is the oscillation of 
[ximme[<d 
J(x)), it can be expanded at every point of the interval as a Fourier 


series in Legendre polynomials, the convergence being uniform in every 
segment [-1+h, 1—h] (h>0). 


6. Jacobi polynomials 


The Jacobi polynomials are polynomials orthogonal in [—1, +1] 
with respect to the weight 


e(x) = (1 — x (1+), (4.115) 


where A>—1, w#>—I1. The weight function (4.115) is Pearson’s 
weight (see § 4, sec. 1). The above definition specifies the Jacobi 
polynomials apart from a constant factor. If this factor is not fixed, 
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we shall denote the polynomials by J‘ (x); we write J%"(x) 
if the coefficient of x” is unity, and J°"\x) if the polynomial ‘is 
normalized. 

The Legendre polynomials (see sec. 5) are a particular case of 


Jacobi polynomials, with 4= %=0. The case 4= = yand 
A=yeb= -5 are specially treated later (see sec. 7, 8). The poly- 


nomials corresponding to these values of 4 and ys are called Chebyshev 
polynomials (of the second and first kind respectively). 

In general, the case A = yw has certain special features, The Jacobi 
polynomials with 4 = uw are said to be ultraspherical. 

Rodrigues’ formula. Formula (4.91) gives for Jacobi polynomials: 


mr 
IMA) = Ag(--ayre Zante", (4.116) 
where we have for Joh Px): 
4, = (- iy" 


Pa+utntl) 
psc eae IT 
Tatptine ld’ fe 


and for J #)(x): 


A = (-1)" p-Gtutonenl Atern+DTU+m+2nt)) 
Las LAtn4tD)PwtntyDnt ~ 


(4.118) 


These formulae are suitable for n> 0. They are also true for m = 0, 
provided A+u+1 +0; if 4+u+1=0, they lose their meaning 
at m = 0, though it is clear that 


Th ex) = 1. 


An explicit expression. If A,, = (—1)"/2"! in Rodrigues’ formula 
(4.116), we shail write j"(x) for the corresponding Jacobi poly- 
nomial. It is often convenient to discuss this Jacobi polynomial. 
For it, the following formula holds; 


Jf) Ox) = 
— 1 BL, Patn4+)Twintl) _ nek k 
= Fri oO Tank Tukey On G+. 
(4.119) 
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A recurrence relation. The general recurrence relation (4.54) for three 
consecutive polynomials of a system of orthogonal polynomials 
becomes, in the case of the system of Jacobi polynomials; 


TERR) = (ange) IIMA) — Angi x), (4.120) 


where 
je-2B 
onta * Tut int 2 +at n+) ’ 
eles A+nt+iI(etnt+IA+utnel) Mn+) 
+1 TF Eten tA +e Fn F2P A + e+ ant3) : 
(4.121) 

Since 

= = A~p 

Ay) G4) = ye 

JQ=1 and JM =x pewrrel 


all the Jacobi polynomials can be obtained successively from (4.120). 
These expressions are very unwieldy, however; e.g. 


_ Asp A—wP+Ad+y)—4 
Gna) = x2+2—— "xp 2 
Jf (x) = x Boy BTW as A+u+3)A+e+4) 


and so on. The explicit formula (4.119) is more practical for their 
actual computation. Complete tables of Jacobi polynomials are 
available (see ref. 3). The Jacobi polynomials satisfy recurrence rela- 
tions, not only with respect to the parameter 7, but also with respect 
to the parameters 4 and n, A, wu and n, these being consequences of 
Gauss’s formulae for the hypergeometric functions; the Jacobi 
polynomials are a particular case of the latter. 

The generating function. Let (x, w) be the generating function of 
the Jacobi polynomials (see sec. 4). Formula (4.96) now gives 

Date “1 
I(x, w) = ————————— (1 +2w + 14+ 40x +40? x 
(x, w) ewer + V ) 
x (1-2w+J14+40x+4w2)7* (4.122) 

and 
St) 


Ix, w= > 


n=o OM} 


wr, (4.123) 
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where 


7m = (1—x)-*(1 +x)" = [(A-x)™ (L4 x94], (4,124) 


The generating function for the Jacobi polynomials is often 
written in the form 
Darth ————————. _y 

se (1 — 1 4+ 1 — 2xt x 
Jl 2xt+t ( v ) 
x (414 J/1—2xtF 8)“, (4.125) 

where t = —2w; the coefficients of the expansion in powers of ¢ 
are now the polynomials i) (see (4.119)), In the case of ultra- 
spherical polynomials (A = yw), the generating function is simplified 
if we introduce, instead of polynomials jx), the polynomials 


U(x, t= 


P(a+4)rm+20 ; 
YO(x) = je*(x), where a=A +z 
PQa)LP (* +a +3) 
in fact, 
(2d yt =F yooer, (4.126) 


neo 


By using the ultraspherical polynomials y%, N. Ya. Sonin obtained 
an analogue of Taylor’s formula: 


feta) = 200) F (n+ yy Zana) _ f), (4.127) 


where J,(«) is Bessel’s function, D = d/dx. 

A differential equation for Jacobi polynomials. Differential equation 
(4.90) for polynomials orthogonal with respect to Pearson’s weight 
function, becomes, in the case of Jacobi polynomials: 


(1— x4)y" + [((u~ a)— (Ut At 2)xly’ +044 m+nt Dy = 0. (4.128) 


Inequalities for Jacobi polynomials and the convergence of the 
Fourier series. Given the condition 
o = max {4, uy} = ~F (4.129) 


the following theorems hoid. 
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THEOREM 28. The greatest value of the modulus of J “(x) is 
attained in the segment [—1, 1] at one of the points x = +1. 

THEOREM 29. Given condition (4.129), the normalized Jacobi poly- 
nomials satisfy the relationship 


a oe 
[J MC)l< Mn? 
for all |x| = 1. 
Here M is a constant, depending on A and wu. 
It follows from Theorem 29 that the Lebesgue function of the 
Jacobi polynomials satisfies 


Ly(x) < Myr?o*?, 
which leads, in conjunction with Theorem 21 (see § 3), to 
THEOREM 30. Let o = 4 and let p be a positive integer not 


less than 20+-2. Every function f(x), defined in [~—1, 1] and having 
a continuous derivative of order p, can be expanded as a uniformly 


convergent Fourier series in the polynomials J »(x). 


7. Chebyshev polynomials of the first kind 


Chebyshev polynomials of the first kind are a particular case of 

Jacobi polynomials (see § 4, sec. 6), corresponding to 4 = p = -> 
wt dt 

The polynomials sh 2°73) were first discussed by P.L. Cheby- 

shev in 1857, when solving the problem of the best approximation 

of continuous functions by polynomials. We shall denote them by 

T,(x); these polynomials were obtained by Chebyshev in the form 


T,(x) = cos (m arc cos x). (4.130) 


Formula (4.130) defines 7,(x) only on the segment [—1, 1]. But 
definition (4.130) can be extended to all values of x by means of the 
familiar trigonometric formula. 


cos np = cos" p— C2 cos"? @ sin? y + C4 cos"-4 p sintp—... 


(this completion of definition (4.130) will be assumed without making 
any special proviso in future). 
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The polynomials 7,,(x) possess many remarkable so-called extremal 
properties in addition to their general properties as polynomials of 
an orthogonal system; these extremal properties will be described 
after dealing with the general properties. 

Rodrigues’ formula is 


d 1 n 
T(x) = An J1— x? — ; 4.131 
w(x) = Ag = =a) (4.131) 
We shall write T,(x) for the polynomial with highest coefficient 
equal to unity, and 7,(x) for the normalized polynomial. 
An explicit expression. Formula (4.130) yields an explicit expression 
for the Chebyshev polynomials, where 


1 


T(x) = Bani 008 (narc cos x), 
; (4.132) 
T,(x) = fz cos (mare cos x), 
Expression (4.130) can also be written in the form 
T(x) = Sl(xt VF= T)?+(x— fxt=1)"] 
oF (4.133) 


n 


2 n 
T(x) = 2 (—1)* caer! Ch_,2n-Bh-1yn-2h, j 


As follows from (4.130), the zeros of T,,(x) are the numbers 


x = cos HD (k=1,2,..., 2). (4.134) 
The recurrence formulae 
Ty, (x) = 2xTp—3 (*)— Th-2 @), (4.135) 
a = Iss 
Ty) = *Ta-1 0) - F Tn-a ) (4.136) 


follow from (4.120) with 4 = u = > Since 7,(x) = 1, Ty) = x, 
it follows from the equation (4.135) that 
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Ty (x) = 2x?-1, 

T,{ x) = 4x? — 3x, 

T,( x) = 8x4 8x? +1, 

T; (x) = 16x5—20x3 + 5x, 

T, (x) = 32x8—48x4 + 18x7+1 
and so on. 


In the case of Chebyshev polynomials, the continued fraction 
(4.62) becomes 


(4.137) 
since here, 
age ee, Beek, ee 
si Avia : 
The denominator of the nth convergent of the continued fraction 
(4.137) is T,(x). The continued fraction is convergent, for all x 
outside the interval (—1, 1), to the function af Vxt—1. 
The generating function. The coefficient of ¢” in the expansion of 


1-2 


Ts, ) = ae (4.138) 
in powers of ¢ is the polynomial 7,,(x): 
1-1? = 
T(x, f) = T-2ixt+ ee = Ty+2 X Troe . 
The differential equation for Chebyshev polynomials is 
(l—x*)y"— xy’ + ry = 0. (4.139) 


Expansion of a function as a Fourier series in Chebyshev polynomials 
and the comparison of this with the expansion as a Maclaurin series. 
Wide use is made of Fourier series in Chebyshev polynomials T,(x) 
for uniform approximation of functions. Notice that the expansion 
of a function f(x) in [—1, 1] as a Fourier series in polynomials T,,(x) 
reduces to the expansion of f(cos x) in [—z, z] as a Fourier series 
in cosines, 
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For instance, 
et coe — T(a)+2 > I,{a) cos ng, 
where J,(a) is Bessel’s function; hence the substitution x = cos y 
gives 
e= = J (a)+2 > I,(a@)T, (x). 


An expansion may similarly be obtained for f(x) = x” from the 
familiar trigonometric formulae: 


] n-1 
cosy = am (& 2C}, cos 2(n—k)p+ ch) , 


no-1 
cos??-1@ = a oe Ch, ~1 cos (2n— 2k — 1g. 


The substitution x = cos@ gives 
1 R=1 hk 
en Jan (= 2Ch,Ten—2n (x) + ch) ’ | 


a 1 "=, (4.140) 
xO) = Sane 2 Con~1Ten—an—1(). 


Similarly, expansions in Chebyshev polynomials T,(x) follow from 
the expansions in cosines (with |x| < 1): 


|x| = 245 y jan) ‘ (4.141) 
Sentek: =5 (- ppt Fanaa) (4.142) 
cosax = J,(a) +25 (—1)"Jon(2)Tan (2s (4.143) 
sin ax = 2 Ds (—1)"*Jon—1(@)Tan—1 2)» (4.144) 


es oo iy Fat ; (4.145) 
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e* = I(a)+2 ¥ (Tr), (4.146) 
n=l 


Inl—2ex +e) = -2F OT (gi<d. 147 


In general, if C, is the Fourier coefficient of f(cos x) in the system 
{cos ny}, we have 


CG. = 2 [7 feos ) cos np dp= a S)Tr@) 
r) mJ m2 


ax 
Vl-x% 

Roughly speaking, when such functions are represented by the sum 
of a like number of terms, the limits of the accuracy are 2"—1 times 
better for an expansion in Chebyshev polynomials than for a Taylor 
series. 


For example, when |x| = 1 follows from (4.146) that, in the case 
of f(x) = e™ with large n, 


. (4.148). 
x 


Cy = 21,(a) = [ae aan ra ‘| mt qloRer? 


while at the same time 
f™0O) a a 


a! ni’ 


If we substitute the Maclaurin series for f(x) 


” (n) 
fe) = 10) +04) to .. Ory .,, 
under the integral sign in (4.148), in view of the orthogonality of 
the polynomials 7,(x) and the expressions (4.138), (4.140), we get 
an interesting connection between the coefficient C,, in the expansion 
of f(x) in Chebyshev polynomials and the corresponding coefficient 
of Maclaurin’s formula for f(x), viz 


= SMO)  f+20) frag) 
oe z{ ml t@HDI1!t @aal2! ). ae, 
It follows from (4.149) that, if the principal part of f™(0)/n! +...) 
reduces to f(0)/n! for large n, we have 


1 £™O) 


ye 


m2 nl 


(4.150) 
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It follows from (4.150) that, given |x| < > the expansion of a 


function as a Maclaurin series is in general better, whereas the expan- 


sion in Chebyshev polynomials is better for + |x| < 1, since 
0 
max |C,7,(x)| = Cn ani < ' max LO ya . 
gy <lelst 


The convergence of Fourier series in Chebyshev polynomials. In view 
of the fact that 
I7T,@)| = 1, 


it follows from Theorem 19 § 3 that: 

THEOREM 31. Given any function f(x), integrable in (—1, 1) with 
respect to the weight \//1—x?, its Fourier series in the system {T,(x)} 
is convergent to the value f(x) at every point x for which the integral 


1 fx)-f(t) _ at 


-1 x-t V1-# 
exists. The Lebesgue function of the system of Chebyshev polyno- 
mials satisfies the inequality 


Lx) 3 2+lnn, 


We therefore have (see Theorem 23 § 3): 

THEOREM 32. Every function f(x) for which 

lim £,(f) Inn = 0, 
N—>ce 

can be expanded as a uniformly convergent series in Chebyshev poly- 
nomials, 

The extremal properties of Chebyshev polynomials. 

THEOREM 33 (Chebyshev). Of all the polynomials with highest 
coefficient equal to unity, the polynomial T. n(x) has the least deviation 
JSrom zero, i.e. 


max |Tn(@)|<_ max 1Qn(x)| 


-1ie21 


Sor all polynomials Q,(x) of degree n, having highest coefficient equal 
to unity. 
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COROLLARY. Since 


- 1 
max |7p(x)| = prH1? 
1 


a 


we have for any polynomial Q(x) with highest coefficient equal to unity: 


max 1Q,()1 > sar 
-1Sx21 

The following interpolation property of the zeros of a Chebyshev 
polynomial is a consequence of the theorem. Suppose we form, with 
respect to the points x,, %, ..., X, an interpolation polynomial 
Q,~1(x) of degree n—1 for a function f(x), 1 times differentiable 
in [—1, 1]. The remainder term of the accurate interpolation is 
now given by 


R(X) = f@) — Qn-1) = 


where 


£O%E) 


n!} 


(x— xy) (x— 2)... — Xp), 


Xp< Xin, and F€ (xy, Xn). 


If the interpolation base-points x, X), ..., X, are zeros of the Cheby- 
shev polynomial T,(x), then 


max |(x—x,) (X—%,)...¢— mp) | 
x€{-1, 1] 
has a minimum value. 

Thus, if the coefficient of f™(€) in (4.148) changes only a little in 
telation to the variation of x in (—1, 1), the interpolation base-points 
which are roots of the polynomial T,,(x), yield the least value of the 
remainder term. 

THEOREM 34 (Chebyshev). Of all the polynomials Q,(x), subject to 
the condition Q,,(&) = M, where |&| < 1, the polynomial MT,(x)/T,(&) 
deviates the least from zero in the segment [—1, 1]. 

THEOREM 35 (A. A. Markov and V. A. Markov). Jf the polynomial 
Q,(x) satisfies, in [—1, 1], the inequality 


10,(x)| = M, 
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the derivative of order k of this polyomial satisfies in [~—1, 1] the 
inequality 
n(n —1)... [n? -(k— 1)? 


10) = M35 e= 


(4.151) 


the sign of equality being obtained in (4.151) only for the polynomial 
T,(x) at the points x = +1. 


8. Chebyshev polynomials of the second kind 


The polynomials of the second kind with respect to the weight 


1/V1—x? (see § 3, sec. 4), i.e. the numerators of the convergents of 
the continued fraction (4.137), form an orthogonal system in [—1, 


1] with respect to the weight o(x) = /1—x? and are therefore the 
Jacobi polynomials corresponding to A= p = > They are known 


as Chebyshev polynomials of the second kind. We shalt denote them 
by U,(x). : 

The Chebyshev polynomials U,(x) and T,,,,(x) are connected 
by the relationship 


U,(x) = Cp - Tag 1(X)- (4.152) 


An explicit expression for the polynomials. We have from (4.152): 


sin [(n+ 1) arccos x] 


JI-# 


Formula (4.153) defines U,(x) only in the interval (~—1, 1), but this 
definition may be extended to all x by means of the familiar trigono- 
metric identity 


U,(x) = Cy (4.153) 


sin(n + Dp = sin**1 p— C2, sin"! pcos? p+ 
+C,, sin"—§ » costo— .... 


In U(X), let the coefficient of x” be unity, while Up ll =1, 
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Now, 
sin [(7+ 1) arccos x] | 


Vi-< , 

a 2 sin [1+ 1) arccos x] 

U,4) = fj — OS _ . 4.155 

sod = [2 Ji-x on 
Recurrence formula. As the numerators of continued fraction (4.137), 

the polynomials U,,(x) satisfy the same recurrence relation as T,, , ,(x): 


T,(x) = 5 (4.154) 


Tysal) = xT nisl) Ty), 


where U(x) = 4, U(x) = x; hence 


& 1 
U(x) a ¥—s, 
= 1 

U;(x) = Bm Fx 


— 3 1 
ee pts pas 
Ux) = x qt ig and so on. 
A continued fraction for polynomials U,(x). These polynomials 


form an orthogonal system with respect to the weight oe(x) = /1—x? 
and are in turn the denominators of the nth convergent of the conti- 
nued fraction 


he (4.156) 


The numerators of the nth convergents of the continued fraction (4.156) 


are U,,-4(x)- For all x lying outside the segment [—1, +1], the con- 
tinued fraction is convergent to the function 


Sx) = (x— Vx*= I). 
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Fourier series in Chebyshev polynomials U,(x). The following 
inequalities hold: 


\0,001< [Ren (-lsxs 1), 
iz 1 (4.157) 
VO < J2 ten (-l<x< 1), 


The next theorems are consequences of (4.157) and the general 
theorems (see § 3, sec. 5). 

THEOREM 36. Every function, having a continuous derivative of the 
third order, can be expanded as a uniformly convergent series in poly- 


nomials U,(x). 

THEOREM 37, Every function f(x) of Lizzm(—1,1) can be expanded 
as a Fourier series in the orthogonal polynomials U,,(x) at every point 
x, and for every f(x) the following integral exists: 


f (2-00 —fit) ) Jizta. (4.158) 
-1 


THEOREM 38. If a function f(x), defined on [—1, 1], satisfies the 
Dini-Lipschitz condition 


lim (6) In 6 = 0, (4.159) 
é>0 ‘ 
it can be expanded in the interval (—1, 1) as a Fourier series in poly- 
nomials U,(x), the convergence being uniform in any interval (—1+ 
+h, 1—h). 


Given suitable convergence conditions, (4.152) enables us to diffe- 
rentiate the expansion 


fx) = 2, nT, (x) (4.160) 
ne 
term by term, to obtain the expansion 


Pa) = Yi nag n—s(2) 
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Expansions (4.139—4.142) given above in polynomials T, lead to 
the following expansions in polynomials U,,: 


22 
em = — Yn ,(a)Un—1(%)s 
a nei 


. _4é¢ 2nU gn—1(*) 
a ar ae 
sin ax = es iy (—1)* 21Jgn(@)Uon-1(), 
a n=l, 
2 oo 
cos ax = es z (— 1841 (n= IJgn-1(QU aa—y@) 
rn . 


and so on. 


An extremal property of polynomials U,(x). 


THEOREM 39 (Chebyshev). Of ail the polynomials Q,(x) of degree 
n with highest coefficient equal to unity, the least value of the integral 


f. On(x) | dx 
-1 


is given by Q,(x) = U,(x). 


9, Laguerre polynomials 


The polynomials orthogonal in the interval (0, +) with respect 
to the weight function e(x) = x%e~* (« > —1) are usually called 
Laguerre or Chebyshev-Laguerre polynomials. 


These polynomials were first encountered in the case « = 0 in 
the analytical mechanics of Lagrange, then in Abel’s posthumous 
papers. Chebyshev discussed the polynomials in 1859, and for them 
obtained a recurrence formula and an expansion as a continued 
fraction; it was only in 1878 that they were considered by Laguerre. 
The case of any « > —1 was first discussed by Sokhotskii. 

Some authors only speak of Laguerre polynomials in the case 
« =0, and refer to generalized Laguerre polynomials when « # 0. 
We shail denote the latter by Z7(x). 
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Rodrigues’ formula is 
a O' - 
L3(x) = Agx7%e* ae (x"Me~*) (4.161) 


The polynomial E(x) with highest coefficient equal to unity is 
obtained from (4.161) with 4A, =(—1)", while the normalized 
L3(x) is obtained with 
(—)° 
A= = —— . 
JniT(ae+n+1) 


A recurrence formula: 
T(x) = (x—a—2n—3) Et, (—( 41) (nta + Lax). (4.162) 
In the case « = 0 this reduces to 
Lysol) = (@—2n—3) Era) —@4 IPL, 
from which we find, using Lo(x) = 1, ,(«) = x—1, 
L(x) = — 4x42, 
I(x) = 8—9x2418x-—6, and so on. 


A continued fraction for polynomials L(x). In the case x = 0, the 
continued fraction (4.162), of which the denominator of the nth 


convergent is L,(%); takes the form 


phe, Se et (4.163) 


x-1l—x-3-—x-5-—x-7-.... 


The continued fraction (4.163) is convergent for all x not lying in 
(0, +0) to the function 


co got 
I(x) = I. er at. 


The continued fraction for any 2, 


IF@+D a+] 2(a +2) 3(~ +3) “= 
x—(a+1)—x—(«@ +3) — x—(@4+5) ~x—(@ +7) (4.164) 


is convergent for any x not lying in (0, +o), to the function 


fix) = i gewines 
0 


x—t 
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A differential equation for L*(x): 


xy’ +(@+1—x)y’ +ny = 0. (4.165) 


Sokhotskii obtained a formula for the power x” in terms of Laguerre 
polynomials: 


n Le_ (x) 
nm 1 Be nS RA. 
x Tinta+ 27 EeeaD 
The generating function is 
att co (_ 1\nyny a. 
(-p-te Fs F Sea (4.166) 


n=od 
Formula (4-166) was first obtained by Sokhotskii. The generating 
function can also be written in the form 
at L(2ivtx) _ & Laer 
(iftx)® =o nt! T(a@+a4+1) 
where J,(z) is Bessel’s function. Formula (4.167) was obtained by 
N.Ya. Sonin. Sonin also obtained the relationships 


1 di) _ 5, de 
a+) rae = LQ) -—a > 


Palt, x) = e (4.167) 


natal (x) sd {ie} (4.168) 
~~ ya=t ero a rf 
x 


Closure of the system {L*(x)}. The problem of moments for the 
sequence 


bn = | e~*xttn dx 
0 


is determinate, from which it follows, by Riesz’s Theorem, (see § 3, 
sec, 7) that the system {L‘(x)} is closed in the space ye 20, + o). 

The Laguerre polynomials can be obtained from the Jacobi poly- 
nomials j‘*'") by means of a passage to the limit: 


LMx) = lim j* »(1-2) (4.169) 
>» 00 b& 
(K. A. Posset’s formula). 
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10. Hermite polynomials 


The polynomials, orthogonal on (—, +0) with respect to the 


a1 
weight o(x)=e ? . are known as Hermite polynomials. This 
name is sometimes given to the polynomials orthogonal with respect 
to the weight e~**, Such polynomials are first encountered in Lap- 
lace’s works, then in those of Chebyshev (1859). Chebyshev obtained 
a Rodrigues’ formula and an expansion as a continued fraction. 
They were considered by Hermite five years after Chebyshev. Ro- 
drigues’ formula is 

x? gn ( - 

H,(x) = Ane? +5 \e 2), (4.170) 
when 4, = (—1)" we get H,(x) — the polynomial with highest coef- 
ficient equal to unity; when 4,= (—1)"/ Jn! J2z we get the normal- 
ized H,(x). 

The recurrence formula is 


Byai(x) = xH,(x)— nH, a@): (4.171) 
since Hx) = 1, A(x) = x, we get 


Hx) = 2-1, 

H,(x) = x8 — 3x, 

FQ) = x'— 6x2 +3, 

H(x) = x—10x°+15x, and so on. 


The generating function is 


2 o n 
OFS Fee (4.172) 


n=O n! 


The continued fraction (4.62), of which the denominator of the 
nth convergent is the polynomial H,(x), is 

Jam 

ek (4.173) 


123 
—x-x—-x-... 
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Fraction (4.173) is convergent for all non-real x to the function 


} ery 
wes et 


A differential equation for the Hermite polynomials: 


yxy tny = 0, (4.174) 


The polynomials H,(x) can also be obtained from the Jacobi 
MM x) as A+ oo: 


polynomials j‘ 
A(x) : 2, x 
a = lim | A 2j7%/ —)]. 4.17 
n! in| ef (=) ae 


Closure of the system of Hermite polynomials. The problem of mo- 
ments for the sequence 


- _ 
In = x"e 2 dx 
is determinate. Hence it follows by Riesz’s theorem (see § 3, sec. 7) 
that the system {H,(x)} is closed in the space L? , s (—, +), 
et 


11. Chebyshev polynomials, orthogonal on a finite 
system of points 


In a paper of 1855, “Continuous fractions” (O nepreryvnykh 
drobyakh), and in certain other works, Chebyshev considered the 
expansion of the sum 

. 6x4) 


G(x,) = m, 
&.7-%x,’ (x) i 


as a continued fraction and investigated the properties of the denomin- 
ators of its convergents, 

If o(x) is a step function with growth points x, x2, ...,Xy, the jumps 
at which are equal to m, mg, ..., My respectively, then 


oxi) i =  do(x) (4.176) 


int 7— Xj gs 2~-x' 
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The denominators of the convergents of the continued fraction (of 
type (4.62)), corresponding to integral (4.176), are now polynomials 
orthogonal with respect to the weight function o(x). 

The orthogonality of P,(x) and P,(x) with respect to o(x) implies 
in this case that 


> 6(x,) P(x) P(xd =0 S#k. 


The continued fraction (4.62) is now finite, the system of orthogonal 
polynomials is also finite and contains precisely N polynomials P,(x), 
P(x), ..., Py, (x). Chebyshev applied the results of his investiga- 
tions to interpolation by the method of least squares which consists 
of the following. The values of the function f(x) are specified at the 
points x,, X2, ..., Xy. Among all the polynomials of a given degree 
n< N, we have to find the polynomial @Q,(x) such that the sum 


y Lf) — Qn)? (4.177) 


is a minimum (see § 1, sec. 3). 
Let 6°(x,) = 1 in (4.176); then 


N eo 
& [f)—OadP = (fF) — Qnfx))? doe). 

And, as follows from § 2, sec. 4, (4.177) takes its least value when 

Q,(x) is the nth segment of the Fourier series of f(x) in a system of 

polynomials orthogonal with respect to the weight function o(x). 

Using a system of equidistant base points on the segment (0, I]: 


4 = (i= 1, 2,...,N). 


Chebyshev formed an orthogonal system of polynomials {6(x,)* = 1}. 
These are also known as Chebyshev polynomials. We shall denote 
them by P, (x) (the polynomial of degree k in the system {x, = 


Py, n(x) = 1+ ayx + agx(x— 1) +agx(x— 1) (x-2) +... 
vee $ayx(x—1)...(x-—k+]), 
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where 
aoe (= 1° CRCh 
5 na—- 1)... (n—stl 


In particular, 


Po, n>) =1, 


x(x— 1) 


x 
Py, n(*) = Ine aa) ’ 


x(x- 1) 
MWN-1) 


x(x— 1) (x—2) 


20-0 = 1) (N=2) ’ 


Ps, we) = 1~125+30 
x(x— 1) 

NN-1) 

x(x—-1)(*-2) 70 x(x— 1) (~—2) (x—3) 
NW—1) (N—2) * ’ W(N—1)(N—2) V3)’ 


Py, n(x) = 1-20 +90 
N 
~ 140 


x(x— 1) 

NW-) 

x(x— 1) (x-2) +630 x(x— 1) (x—2) (x-3) 
N(N— 1)(N—2) N(N— 1) (N—2) (W— 3) 
Ax-N&-DE-DO-Y 
NN — 1) (N~2)(N ~ 3) (N— 4)’ 


P,, n(x) = 1-30 +210 
— 560 
—252 


and so on. The interpolation polynomial of degree m with respect 
to the system base points {x,; = i/N} for f(x), defined by the method 
of least squares, is the segment of the Fourier series of f(x) of order 
m with respect to the system {P,, y(x)}: 


Omlx) = 5° CyPr, w(2), 
k=0 


where 


Ch = (e S(X)Pp, nC) do(x) = ¥ SadPa.vl. 
0 
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The expression for C,, does not depend on the degree of interpo- 
lation m. On increasing the degree of the interpolation polynomial 
new terms are simply added: 


Oma1(X) = Om(X) af Cmte m4i, n(x) : 


Chebyshev showed that the case when o(x) is continuous can be 
obtained by means of a passage to the limit from the case when 
o(x) has a finite number of growth points. 

In particular, the Legendre polynomials can be obtained from the 
polynomials P, y(x) as N + 9. If L,(x) is a Legendre polynomial, 
normalized by the condition that L,(1) = 1, we have 


L,Qx—1) = cae in| (ee oth, 


CHAPTER V 


CONTINUED FRACTIONS 


Introduction 
1. Notation for continued fractions. Basic definitions 
An expression of the form 


a, 
byt a 
Bb, +2 

2 +h +. 


ta oles 
+— 
b+. 
is called a continued fraction. 


In view of the unwieldiness of the above method of writing, several 
authors have proposed different methods, for instance: 


bo tae tet... Ho te, Pringsheim 
Mae it es peters 
q . aa . . an . sat 
Pot pt oh tet eek (Miller) 
bee oy on : (Rogers) (5.1) 


By dB ty cee He: 


We shall use the last notation. Pringsheim also proposed writing a 
continued fraction in the form [bg; a,/b,]?. If a,, and 5, in frac- 
tion (5.1) follow a different law to the remaining a, and b,, Pringsheim 
used the notation [bg; a,/b,, 9,/b,}>. 

The fraction a,/b, is called the n-th partial quotient of the continued 
fraction (5.1); a, and 5, are the terms of the n-th partial quotient; 
4%; , G3,... are called the partial nwmerators of the continued 
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fraction; b,, b,, bs ,... are its partial denominators; by is called the 
zero partial quotient. , 

All the terms of the partial quotients will be assumed finite; all 
the partial denominators are usually assumed to be non-zero. 

A continued fraction having a finite set of partial quotients is 
described as terminating. 

A continued fraction having an infinite set of partial quotients 
is described as non-terminating. 


2. A brief historical note . 


Algorithms similar to continued fractions were employed even by the mathe- 
maticians of antiquity (Euclid’s algorithm, the Archimedean approximation to V3. 
Of the médiaeval mathematicians, Omar Khayyam (c. 1040-1123) came close 
to continued fractions when trying to generalize Euclid’s algorithm to the case 
of incommensurable magnitudes, but continued fractions as such first appeared 
in the “Algebra” of the Italian mathematician R.Bombelli, published in 1572. 
A number of outstanding mathematicians of the seventeenth century, including 
J. Wallis and Chr. Huygens, occupied themselves with continued fractions, but 
the founder of the theory of continued fractions as an independent branch of 
mathematics was Euler. Almost all the great mathematicians of the eighteenth 
century and the first half of the nineteenth century made some contribution to 
the development of the theory. Interest has recently returned afresh to continued 
fractions, owing to their great theoretical and practical value. In particular, con- 
tinued fractions are employed in various approximate computations. For instance, 
with their aid we can compute approximately the values of many functions, the 
power series expansion of which are slowly convergent or even divergent. 


§ 1. Continued fractions and their fundamental properties 


1. The evaluation of convergents. Convergents 


The terminating continued fraction 
a 4, a P. 
5, a 2 a, ae: 
OT i By bck ~ Oe 
is called the nth convergent of the continued fraction (5.1), We put 
here 
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Basic recurrence relations: 
Pa = bpPno1+nPa—2 
Qn = OnQn-1 + FnQn-2 


Equations (5.2) enable the convergents to be evaluated successively. 
It is useful here to employ the following scheme: 


(mn = 1, 2, 3, ...). } (5.2) 


a. a ay, 
b+ pus ; 
OT by bby +ba+.. 
Lo A hm Ph 
01 8 ® Q,°* 


EXAMPLE 1. 


Goetatie ais dee 


1 


+ 
-s 


agate yhe, Wy el. lh 
= 242+ 24 2 + 2+ 
ee eee rg a 
0 12 5 2 2% 7 


1 15 1:4 L417 1:4138  1:41429. 


The difference between neighbouring convergents is 


Pa Pat _ 7 pynt Mr Gn 2 ” 
Qn Qn-1 (=D Oye (a = 1, 2, 3, ...) (5.3) 


The difference between convergents whose indices differ by 2 is: 


Pasi Pao eee 

aetl oaad = (tpt eee on = 1, 2, 3,2). SF 

Ca Oa Oa ee 
Continued fractions whose partial quotients have positive terms. 

It follows from equations (5.4) that, if all the terms of the partial 

quotients are positive, the convergents of even order form a mono- 

tonically increasing sequence, bounded from above by the number 


by+a,/b,. Such a sequence has a limit. Consequently, lim P,,/Qon 
n—->co 


exists in this case. Similarly, if all the terms of the partial quotients 
are positive, the convergents of odd order form a monotonically 
decreasing sequence, bounded from below by the number bo. Such a 
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sequence also has a limit. Thus lim P,,_,/Qo,_, also exists. Thus 


n—> co 


the value (if it exists) of a continued fraction, of which all the terms 
of the partial quotients are positive, is always greater than any con- 
vergent of even order and less than any convergent of odd order. 


The number lim P,/Q,, is taken to be the value of a continued frac- 
n—> co 


tion (5.1). 


2. Transformations of continued fractions 


The fundamental identity transformation is 


a ay ay 


eee Pas 


by + 
Pity PrPoea Pn=1Pna (5.5) 
Piby + Poby +... + Pnbp +... 
where p,, Po,... are any numbers, finite and non-zero. 
Ordinary continued fractions. By using transformation (5.5), we 
can always reduce a continued fraction (5.1) to the form 


‘ee 1 


Sqyt—— =e , (5.6) 
hy tat... Fant... 
where 
en BS 94 + + + Aan abap—1 — N43 + + Onp~1D 2p 
OO Mon Se AOR 
QyQ3. . . QoR—4 AnQy. . . Ap 


We call (5.6) an ordinary continued fraction, while the numbers @,, 
@,...are the partial denominators of the ordinary continued 
fraction, : 

An ordinary continued fraction with positive integral partial 
denominators is said to be regular. Only regular continued fractions 
are usually considered in the theory of numbers. 

Continued fractions, of which all the partial denominators are equal 
to 1. Such fractions are obtained from the fraction (5.1) by a trans- 
formation (5.5) in which we put p, = 1/b,(7 = 1, 2, ...). When 
by = 0, such a fraction has the form 

4 Cy oy 


Tete teens (5-1) 
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where 


The terms of the partial quotients of fractions (5.6) and (5.7) are 
connected by the relationships 
= ah Cy = ! 
oy &y—1%n 
Daniel Bernoulli’s continued fraction. The continued fraction, the 
convergents of which are equal to Ko, K;, Kz,..., has the form 


Ky—Ky Ki-Kz (Ki — Ko) (Ka— Ks) © 


(mn = 2, 3, ...). 


Rt eRe RR eke 
(Ky-2~ Kn—s) (Ka-1- in) 
MAn-27 BnodAnait Ad 5.8 
ae Ki=kas ie ce! 


EXAMPLE 2. The continued fraction for which K, = 1/(+1)* 
(1 =0, 1,...), bas the form 


3° «15 37 59 (2n — 3) (2n+1) 
41~42-43-44-...- 4n Tee 
1 1 3 415 

YT 4 #2 240°" 


K=1- 


3. Contraction and extension of continued fractions 


If we take as Ky, Ki, Ko,...some subsequence of convergents of 
fraction (5.1), we say that the fraction (5.8) has been obtained by 
means of a contraction of fraction (5.1). Whereas, if we take as Ky, Ky, 
K,,... a sequence which includes in particular all the convergents 
of (5.1), we say that the fraction (5.8) has been obtained by means 
of an extension of fraction (5.1). 

After putting K, = P,,/Qy,, we have 


a4 a an ayb. 
aS Se SEE NT ee thats = 
Qozb, aAsbyb, 
— Babs + 45)by + Baty — (E405 + O5)bg +45 — - -- 
Gyn —24an—10 on —4P an . 6.9) 


vee (Onn 282n—~1 + Gen—Dbon + Don—24an — +++ 
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EXAMPLE 3 
ie 2 1 1 1 
ae er am aa fe ee 
17 41 239 
7 5 29 169 


On putting K, = Poni,/Qony1, We have 


eo em 
On By Eben bby Bex es a4 = 
yb; 434,505 


~ (byby + 42)b3 + bya, ~ (O34 + 44)b5 + Bgag— --. 


Qn 14anPon—sbons1 . 

+++ (Oan—1b2n + Gen)bangi + ban—14ensi— +++ 
Here, the sign = indicates that the convergent of zero order of 
the continued fraction on the right-hand side of the last equation is 


the fraction 1/0, and not 0/1, since this continued fraction has for 
its convergents the convergents of odd order only of continued frac- 


tion (5.1). 
EXAMPLE 4. 
1 1 ee | 1 1 
‘y= _— — = — — 
RAN OPPS ON Bes it gS 2 ige =) & SoG A 
1 5 29 169 985 


0 2 12 7 408 


If we replace the sign + by the usual equality, we get the expan- 
sion 


5 . 5 1 I 1 
Ae ee ee ee ae 
5 30 175 1020 


The connection between ordinary and singular values of a continued 
fraction. If by = 0, the continued fraction (5.1) can be considered in 
two ways, depending on whether we take its zero order convergent 
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as equal to 0/1 or 1/0. In the first case the values of the continued 
fraction are described as ordinary, and in the second as singular. 
On writing K and K respectively for the ordinary and singular value 
of the same continued fraction, we have 


pony any Rta & 

~ by tbgt...’ ~ by +b + 
O a ab, lia ata 
1 b, bb +4 0B bby 


0 a ab,+a, 
1 b bb, 


It follows that the connection between K and K is given by 


a, 
5,K+5,—a 


4. The transformation of a continued fraction resulting from a 
theorem of Stolz 


The following is well known in mathematical analysis: 
STOLZ’S THEOREM. Let 
Lim P, =~, Lim Qn = - Qui: > Qn 
n—> oo n—> oo 
Sor all n. Then 
P. PuaiP, 
lim fu = lim n+1 n - 
Nh» co Qn N=~> oo Qn41—-Qn 
if the limit on the right-hand side of the last equation exists, 
By using this theorem and the basic recurrence relations (5.2), 
we can transform the fraction (5.1) into a continued fraction, whose 
nth order convergent is (P,—P,_,)/(Q,—Q,_,), where P, and 
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P,,_, are respectively the numerators of the mth and (7—1)th order 
convergents of the continued fraction (5.1), while Q, and Q,_, are 
the denominators of these convergents. This continued fraction 


has the form 


a Qn, a Ay +by—1 
a ou =p pos Sve 
ae a a ac Ea a 
a3+b,—1 Gn+b,—1 
a + by— 1 a Geni Pada 
a,+b,-1 iz ay +b,—1 
+ bg car Res See es ak by ae eee eR (ea 
EXAMPLE 5 
I 111 
V3 = 14554747 4 7 
1235798 
Lol 34 1 
Saupe eae, Ae IE |. 
~ O41 ¢143 47434... 
de fice, Boe 
1 0 2 2 1 


A more general transformation of continued fraction following from 
Stolz’s theorem. We apply Stolz’s theorem to the sequence 


YnPn ce 
Ba, GeO, 1p 20 


where P,/O, (n = 0, 1, 2,...) are the convergents of (5.1), and yo 
Vis Yoo» +- are any non-zero numbers. Now, if the inequality y,Q,, > 
Yn-12n—1 is satisfied for all m, we have, by Stolz’s Theorem: 


lim Pa lim YnPn a Yn—Pn-1 


n+eQ_ neo YnQn—Yn-12n-1 


if the limit on the right-hand side exists. 
By using this equation and the basic recurrence relations (5.2), 
we can transform (5.1) into a continued fraction, whose mth order 
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convergent is (¥,P,—Yn—Pn—1)/(YnQn—VYn—-12n—1): This continued 
fraction has the form 


a; ay a, 
K sh po et ae 
al ee A ee Se a 


1 
ae Ce by — 
"dy "1 (Vi¥242 + Yo%2b2 — YorD 


= by + 
Yb — Yo + A | + 
V1 
Ya¥303 + Vi¥s03 — Vie a 
Vang + YoVaP2 — Yor 
Yass — Ye, Yo VaVe@s+Vivabs—Vi72 +--+ 
V2 Y2 VrY242 + YoY2b2— Yor1 
Yn—1Yn4n + Yn—2¥nPn — Yn—2?n—1 
Yn—2?n—19n—1 + ¥n—3¥n—-19n~1~ Yn—3¥n—2 
YnOn —Vn-1 4 Yn-3 Va—1¥ nan + Yn—2¥nln 7 ¥n-2¥n-1 
Yn-1 Yn—-1 Yn—2?n-19n-1 + Yn—3Yn—19n—1 ~ Yn—3Vn—2 
ip ee 


+ 


G&y-1 


+ 


EXAMPLE 6. 


It 95 319 (PF -3n4+)I) OP +n-l) 
+12 4+ 26 +444...4 2(r2 — 3) bese 


235 7535 
1T 1 165 5335 

This gives us an expansion of V2 as a non-periodic continued 
fraction. In number theory there is a theorem which asserts that every 
irrational square root can be expanded as a periodic continued 
fraction and that, conversely, the value of every convergent periodic 
continued fraction is some irrational square root. But it is not always 
pointed out that an irrational square root can also be expanded asa 
non-periodic continued fraction, there being an infinity of such ex- 


pansions. The expansion. of 2 obtained by us as a periodic con- 
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tinued fraction is more slowly convergent than the initial expansion 
of V2. 

Corollaries of Stolz’s theorem and transformations of continued 
Sractions following from them. Let the sequence {P,/Q,} satisfy the 
conditions of Stolz’s theorem. The sequence {P2/0?} now also 
satisfies the conditions of the theorem. Therefore - 


«> P, - PatPre 
lim = lim —27—2-1 |, 
n>0oOn n> 0 Ont+Qn-1 


We can obtain, on the basis of this equation, the following trans- 
formation of a continued fraction: 


a Gn ay 
me Sy ape g Or 
Heth pcb eee Ree 

b3— a3 +1 ba— antl 

by +1 By— a, +17 ay ees ia . 

— b+1l + b,—a3+1 . ba— antl 
b3+1 Fal ae bah les 
EXAMPLE 7 
1 1 #1 42 

tT Tea ae 


Teen ae aes 

Bis Fe Pea A Ai 
The following equation may also readily be obtained from Stolz’s 

theorem: 


lim Pa = lim YnPntVYn-nPn—r 


non neo PnQnt¥n—nQn—n 


where {y,} is a sequence, the terms of which are all non-zero. We 
can obtain on the basis of this equation as many different identity 
transformations of a continued fraction as desired. 
A further transformation of continued fractions. Let us consider the 
identity 
a % bb 4 & 


bp & cee 5.10 
fT Phi Feu beats Git) 
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Let us suppose that the convergents of even order of the fractions 
appearing in this identity are equal if their indices are the same. 
Now, on performing a contraction of the continued fractions and 
using the basic identity transformation to make corresponding terms 
of partial quotients of the contracted fractions equal, we obtain the 
following two systems of equations, connecting the terms of the 
partial quotients of the initial continued fractions: 


— boyd, = aby, 


S11 
Cala, = a,agb,, ee 


and Con—2Con—149n = Gon—242n-1P2n—sPan N= 2, 3, .... 


Cyd, + Aida + Cz = byb, +a, 
(dan—2dan—1t Can—1)4an + dans2Con = (5.12) 
(n = 2, 3, ...). 


= (ben—adan—1 + Gon—1)Oan + Oan—242n 


Systems (5.11) and (5.12), taken together, contain 2n equations 
with 4n unknowns c, and d, (7 = 1, 2, ...). It is thus impossible, 
in the general case of equations (5.11) and (5.12), to express c, and 
d,(n = 1, 2, ...) im terms of a,, a,..., 5), by,... or, conversely, 
a,, b,(n = 1, 2,...) in terms of c, @,..., a, d,.... Butifdy = 
=]; Cp = ay, don, = bans doyick = A Pon—1 (a= 1,2,... he # 1), 
the identity (5.10) takes the form 


a 4a an, 
142 2 ~~ = 

Bae ea aaa 8 ee 

eape a a. ae 

© 1 = ayby + byby + 2a, — 1 — bybyby +-2a,bp+2ayb, - 1... 

Gyn—1D on Aonbon 2 
ee ban aden iden + 2gn—1)2n + 24enPon—2 — loo... 
(5.13) 

EXAMPLE 8. 

i 1 1 2 1 61 1 1 1 
P=l+e = =- i+ se + = 
V2=14t5 54 [Dene Nes Gs eee ea ree aa 

ol 8 7 48 41 280 239 
Tl 6 5 34 29 198 169 
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If the equations 


are satisfied, then equation (5.10) takes the form 


a a a, 
ta —_ = 
Bi ey Sear an te 


Toa a & Gont1 Gan (5.15) 
1 —'b, + by + bgt... + bon t+bongi tess . 


5. The properties of regular continued fractions 


A continued fraction in which all the partial numerators are equal 
to unity, and all the partial denominators are positive integers, is 
described as regular, or arithmetical. It follows from equation (5.3) 
that all the convergents of a regular continued fraction are non- 
reducible. 

Euclid’s algorithm and the expansion of rational numbers as regular 
continued fractions. Let u and v be two given positive integers, where 
u> vy, On dividing u by v, we have 


uu 4 
y ~ 4% y? 


where qp is the quotient and u, the remainder. On dividing v by m4, 
we have similarly 
¥ Lar) 


eo 


Proceeding in this manner, we get 


us 

4 oe 
and so on. This process of successive divisions is known as Euclid’s 
algorithm. Since u, u, ue,... is a monotonically decreasing sequence 
of positive integers, the process is finite, ie. there exists an index n 
such that u,_,/u, = 7, (consequently, u, # 0, u,,, = 0). Hence 
u,, is the greatest common divisor of the numbers u and v. It is often 
denoted by (u, v). 
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EXAMPLE 9. Find the greatest common divisor of the numbers 
816 and 323. 
The computation is usually set out thus: 


816 | 323 
~ 646 2 
323 | 170 
=a It 
170| 153 
153]17 1 
0 9 


(816, 323) = 17. Thus the expansion of 816/323 as a regular continued 
fraction has the form 


6 yt 2 1 
323 1+1+9 
23 5 #& 
1 1 2 19° 


Thus Euclid’s algorithm enables us not only to find the greatest com- 
mon divisor of two positive integers, but also to expand their ratio 
as a regular continued fraction. 

The solution in integers of an indeterminate equation of the first 
degree with the aid of Euclid’s algorithm. The equation ax+by = c, 
where a, b and c are known, while x and y are unknown, is known 
as an indeterminate equation of the first degree. Such an equation 
has an infinite set of solutions. But it is often required to find only 
the integers that satisfy the equation, ie. in conventional language, 
it is required to solve the equation in integers. We consider here only 
equations for which a, b, ¢c are integers. The equation ax+by =c 
has an integral solution only in the case when c is divisible by (a, 5). 
We can thus always assume that a and b are mutually prime. In this 
case the general solution in integers of the equation has the form 


x = (—1)""'cQ,_1+ (On, 
y = (—1)ePp_1— Pa 


where ¢ is an arbitrary integer, P,_, and Q,_, are the numerator 
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and denominator of the penultimate convergent in the expansion 
of a/b = P,/Q,, as a regular continued fraction. 
EXAMPLE 10. 43x+37y = 21. 


eck eee 
ay61 3 6+6 
6]1 6 1 7 4 
0 6 T 6 #37 


x = —21.6437t = 37-126, 
y = 21.7—43t = 147— 431, 


x = 37t-15, y= 18-432, 


where again, ¢ is any integer. 

The convergents of a regular continued fraction as best approxima- 
tions. Suppose we have expanded any real number A as a regular 
continued fraction. Let us write P,/Q, for the mth order convergent 
of this continued fraction. The following inequality now holds: 


1 


P, 
A->— é 
QnQns1 


Qn 


= 


These convergents are best approximations to the number 4 in 
the sense that no rational fraction with denominator not exceeding 
Q,, can differ from A by less than the fraction P,/Q,,. 

The expansion of an irrational number as a non-terminating regular 
continued fraction. Every real irrational number can be written uniquely 
as a non-terminating regular continued fraction. Conversely, every 
non-terminating regular continued fraction (such a fraction is necessar- 
ily convergent, by Seidel’s convergence test, see § 2, sec. 2) is the 
expansion of one and only one real irrational number. 

Periodic regular continued fractions. The regular continued fraction 

es 
ON a dete: 
@, --. Of its partial denominators consists of a repetition, with 
the same period, of the m numbers 9, q;,-- +» Gn—1- 

If the repetition starts with some q,(k = 1) instead of with go, the 
regular continued fraction is described as mixed periodic. 


is said to be purely periodic if the sequence go, 41, 
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Similar concepts of periodic continued fractions may also be intro- 
duced for continued fractions of a general type, although regular 
periodic continued fractions are primarily discussed in number 
theory. 

The expansion of irrational square roots as periodic continued 
fractions. Every periodic continued fraction (not necessarily regular) 
represents an irrational square root. An important role is played 
in number theory by a theorem of Lagrange, which states that 
every irrational square root can be expanded as a periodic regular 
continued fraction. 

For example, 


Agog deed) dT kh Ay 
= L+id+1l414+6+14+141+6+..- 


Notice that the expansion of 713 as a continued fraction of general 
type, 
2 1 1 «421 


4 
13 = 346/13 <3) = 344} — Se Se . 
se ) 34/5 34343434... 


is obtained more simply and is more rapidly convergent. Thus the 
expansion of irrational square roots as regular continued fractions 
is more of theoretical rather than practical interest. 


6. Equivalent and corresponding continued fractions 


When transforming the power series Aj+A\x+A,x?+... 
into a continued fraction, two cases can be encountered: (1) the 
convergents of the continued fraction coincide with the partial sums 
of the initia] power series; (2) the convergents do not coincide with 
the partial sums of the initial power series. In the first case the con- 
tinued fraction is described as equivalent to the initial series, and in 
the second case as corresponding to the initial series. The expansion of 
the nth convergent of the corresponding continued fraction as a power 
series coincides with the initial power series up to and including the 
term in x”. It is clear that an equivalent continued fraction is only 
another form of writing a power series and does not yield new appro- 
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ximate expressions for its sum..As regards convergence, a power or 
numerical series and the continued fraction corresponding to it can 
behave differently. They may be both convergent, or both divergent, 
or one be convergent and the other divergent. The domains of conver- 
gence of a power series and the continued fraction corresponding 
to it may thus be different. For instance, there are power series with 
radius of convergence equal to zero, which can be transformed into 
corresponding continued fractions that are convergent in a fairly 
wide domain. 

Equivalent continued fractions can sometimes be readily transform- 
ed into corresponding ones by means of the transformation (5.13). 
Since it is far easier to construct the equivalent rather than the 
corresponding fraction, the application of transforming equivalent 
fractions into corresponding ones is of practical interest. 

The construction of equivalent fractions. For this purpose it is 
easiest to employ Evler’s identity: 


F eax" = C94 oe CX C403X Cy—2CnX ; 
n=0 Cy CQX— Cg CgX— 60. — Cpu tln¥— oe. 
(5.16) 
This identity can also be given the form 
3 cx" = Lo yx ColoX Cy CX 
n=0 L = Cg tex Ch + OQX— Cg tegx— ... 
Cn—2CnX 
Peat to 2 3.1 
2 Cpu ten X — 1 GD 
EXAMPLE 11. 
wimg es oe = 
See antsy wee = 
moe x? 9x? (2n — 1)?x? i 
~ 7 43—x? + 5-322 4 2... +2nt1—(2n—1)x? +... 


In particular, when x = 1 we have, 
fd Ll Ps. Ss  P (2n—1)? 


Pe Peo Pee ee 2 ae 
01 2 13 76 789 
TT 3 15 105 985 
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The last expansion was first obtained by Brouncker (1620-1684). 
This relationship is regarded as historically the first expansion of 
a transcendental number as a continued fraction. 

On applying transformation (5.13) to the expansion of arc tan x 
as an equivalent continued fraction, we get the continued fraction 


arc tanx = x— coast 72 
= 1S49x% 1 iaits 
x 1Sx+4x243x5 15x— 5x3 +325 
1 15 49x? 15 


which is no longer equivalent. In particular, when x = 1 we have 


2 9 2 49 81 (4n—1)? 
24-1 —i2- 1 -#8-—...~ fT - 


1 2 13 1426 789 
1 24 15 1680 945 


we 
aot 


(4n+ 1)? 
ye) 


7. The formation of corresponding fractions. Viskovatovy’s method 


The terms of the partial quotients of the corresponding continued 
fraction can be expressed in terms of the coefficients of the terms of 
the initial power series, although high order determinations appear in 
the relationships thus obtained. This makes such relationships of 
little practical use in the majority of cases. It is therefore better in 
practice to use a method of successively obtaining the terms of the 
partial quotients of the corresponding continued fraction from the 
terms of the power series. Such a method was proposed in principle 
at the beginning of the nineteenth century by the Russian scholar 
V. Viskovatov. Viskovatov’s method amounts to the identity, 


ce yg HLyyX HL yQX* +4 gx +...  %10 YX LaqX 
oq tHoX HA ggX*+AggXP+ ... Log Mig + yg +...’ 


where 


Smn = %m—1, o%m—2, n+-1— %m—2, 0% m—1, n+ 
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Computation of the coefficients a,,, may be conveniently set out 
in accordance with the scheme: 

Xoo %o1 Son +--+ 

Oyo Fy My eee 


hog Cay Ogg see 


EXAMPLE 12, Let us expand the expression (1—x)/(1—5x+ 6x?) 
(x < 1/3) as a continued fraction. We have 


1 -5 6 
1 -1 
-4 6 
—2 
~12, 
Consequently, 
l-x i 4x 2x 12x 
1—S5xt+6x?  T-~ T -— —4~- =2~ 
a ee = 
l1- 1 + 2 - 1 
i 1 24x 2—2x 
1 


1—4x 2-—7x 2—10x+12x? 


If, when computing the coefficients «,,,, it turns out that «,, = 0, 
then the (k+2)th row of the scheme is obtained by means of a shift 
of the (k+ 1)th row one place to the left; the (k+3)th row is obtained 
by combining the (k+2)th and the kth rows in accordance with 
the general rule, the (k+4)th row by combining the (k+3)th and 
(k+2)th, and so on. The expansion in this case has the form 


fo) = Hq AagX A gqX 
Boo + Xo + og +... 
Pie 7 
pig oX py yX® par X Chae, 1X 
ee ee SS wee, 
cee + Op 2,0 t&%p-aot %,1 + %rti1 +--- 
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EXAMPLE 13. Let us expand the expression {1—3x°)/(1—x?— 4x‘) 
(< (V17. —1)/8) as a continued fraction, we have 


[a3x0 1 xe 3x Sx 25x 300% 15x _ 
T—x?-4x4  T— 1 —--1--34+-5+ 25-1 
oh | 5x 
“i- 1 + 1 _ 3 + 
OL 1 1+3x 3+34x 
LT t= 14+3x—x® 344x—3x? + 5x3 
Sx 12x ax 
+ T - 5 ~ i 
349x + 15x? 15+9x +4 27x? 15 — 4533 
34+9x+412x% 15+49x+12x2 +36x3—60x4 15—15x*7- 60x! * 
1 0 -1 0 -4 
1 0 0 -3 
0 -—1 3 —4 
~-1 3-4 
—3 4 3 
-5 15 
25 —15 
300 
— 300.15. 


8. Appell’s method 


In 1913 Appell proposed the following method enabling any 
positive number to be expanded as a continued fraction. 

Let N be any positive number. Let a be the square root of N, comput- 
ed with a deficiency of not more than 1. Thus N = a?+R, where 
0<R <2a+1. Weshallassumea = 0ifN~< 1. We put R = (24+ 1)/M, 
where N,>1. Let a, be the square root of N,, computed with 
deficiency of not more than 1. Then N, = a?+R,, where 0< R,< 
~<2a,+1. We put R, = (2a,+1)/N, and continued this process inde- 
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finitely. Generally speaking, N is now expanded as a non-termin- 
ating continued fraction. 

If N, = N, Nis expanded a pure periodic continued fraction. If 
N, =N,,(1=m <p), N is expanded as a mixed periodic continued 


fraction. é 
EXAMPLE 14, 
5 5.5 
= May ae Bast = = So 
S=Prl=PF+s, M=N S=P+R 
EXAMPLE 15, 

3 3 3 
= 2a =. {22 isn P Sa encse 
2=P45, 3=1 ro Paes 

2 

5 5 3 
a5 OR ee = 
cars ZaP+ys NHN. 
2 
3 3 3 5 3. 3 
Spe tak OR eet, en Be 
meas SLE eS LEM 6Le a oo 
second period 
EXAMPLE 16. 
14/13 42, = - 
2 124 127+ 12+ 


Appell also pointed out the more general relationship 


Wear Gt Dae (tira 


a + a tee 

Here a,, a,... are positive integers, while a may also be equal to 
zero. Here we can take the mth root of the number with a deficiency 
or with an excess of not more than 1, or we can even alternate in 
various ways the approximation of the root with a deficiency and 
an excess in the expansion obtained. 
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§ 2. Fundamental tests for the convergence of continued 
fractions 


1. The convergence of continued fractions 


It was mentioned above that a continued fraction for which lim 
n—>» co 
P,,/Q,, exists and is finite is described as convergent. The value of the 


continued fraction is in this case taken equal to this limit. But it does 


not follow from the convergence of a continued fraction that lim 
TR~y oo 


P,/@, is equal to the magnitude which has been expanded as the 
continued fraction. 

Essentially and non-essentially divergent continued fractions. If 
lim P,/Q, = + ~ or lim P/Q, = — ~, the continued fraction is 


n= oo n—> oo 


said to be non-essentially divergent, whereas if lim P,/Q, does not 


N—> oo 
exist, the continued fraction is said to be essentially divergent. The 
concepts of essential and non-essential divergence were introduced 
by Perron. 
Unconditionally and conditionally convergent continued fractions. 
Unconditionally and conditionally convergent continued fractions. 
It is well known that the convergence of a series or infinite product 
is not affected by the removal of a finite set of terms. In continued 
fractions, however, the removal of a finite set of partial quotients 
(excluding the zero partial quotient) can turn a convergent fraction 
into a non-essentially divergent fraction. Pringsheim therefore intro- 
duced the following concepts: a continued fraction [a,/b, |? is 
said to be unconditionally convergent if, for all m 21, the fraction 
{a,/b,]” is convergent. Whereas if the latter fraction is divergent 
for at least one value of m, the fraction [a,/b,]? is said to be 
conditionally convergent. It follows from this that it is not in general 
possible to quote convergence tests for continued fractions in the 
limiting form as used for series, The convergence conditions, connect- 
ing, say a, and b,, must be satisfied for all positive integral n. It 
‘must be emphasized that the removal of a finite set of partial quotients 
can turn a convergent continued fraction only into a convergent or 
a non-essentially divergent fraction. 
A necessary test for the convergence of a continued fraction [1/x,]. 
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Kocn’s THEOREM. The convergence of the series x || 
sufficient for the limits lim P,, = P, ies 1 Pan 41, = Pt Tim’ Oy, = =Q, 
lim Q,,4, = Q’ to be Failte. and the relationship P’ Q- _PO' = 1 to be 
satisfied. It follows from this that the divergence of the series . ja, 
is necessary for the convergence of the fraction [l/a,}°. re. 


Uniform convergence of a continued fraction. If the terms of the 
partial quotients of a continued fraction are functions of a finite 
or infinite set of variables, the continued fraction is said to be uni- 
formly convergent on the set E of variation of these variables when 
its convergents P,/Q,, tend uniformly to a limit in £, ie. when, given 
any e > 0, we can find a number N such that, form = N, Q,is non-zero 
on the whole set E and the following inequality holds: 


P. 
lim — 


ieee ees 
Qn A> co Q, 
It follows from this definition that the series (see [3]): 


Py — P,, at Py a a eee 
— — = + —])j4-1 = 4 * 
( On ya ) 03-10, 


(5.19) 


<6 (5.18) 


is now uniformly convergent in £ to lim P,/Q,, since P,/Q,, is its 
N—> oo 
partial sum, while lim P,/Q,, is its sum. Conversely, condition (5.18) 
n> oo 
follows from the uniform convergence of this series, i.e. the uniform 


convergence of the continued fraction, Jt also follows from this 
definition that the values of the continued fraction and of the series 
(5.19) coincide for any x € E, ie. that the continued fraction and the 
series (5.19) are identically equal on the set E£. 

A condition for the convergence of a continued fraction to the function 
which can be expanded as this continued fraction. The uniform converg- 
ence of the continued fraction 

Cy CyxX nx 


Fa Pa GzG m=.) 620) 
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on the set Fis a sufficient condition for this fraction to be convergent 
on the set £ to the function K(x), which can be expanded as the con- 
tinued fraction. 

It follows from this theorem that, if the fraction (5.20) is uniformly 
convergent for |x| <9, itis convergent for |x|<o to a regular single- 
valued analytic function, which can be expanded as the fraction 
and which can be expanded as the power series corresponding to the 
fraction (5.20), this series being convergent to the same function 
for |x|<o. The condition is therefore obtained in order that the 
continued fraction and the power series which correspond to each 
other are convergent to the same function. Notice that the domain 
|x| <@ can be replaced by any domain T containingzero as an interior 
point. 

If zero is a boundary point of the set E, then 0 = 0, i.e. the power 
series corresponding to the fraction (5.20) is divergent everywhere 
except at zero. But the fraction (5.20), uniformly convergent on the set 
E, is nevertheless convergent on this set to the function that we have 
expanded as this continued fraction. This function can be expanded 
in the present case in a neighbourhood of zero as a divergent power 
series, i.e. it is not analytic. The convergents of the fraction (5.20) 
are thus approximate expressions for a non-analytic function, i.e. 
we have to some degree solved the problem of the approximate 
evaluation of non-analytic functions, 

The condition for identical equality of two uniformly convergent 
continued fractions. If the values of two continued fractions, uniformly 
convergent inside a domain JT containing zero as an interior point, 
are coincident in a domain S which is contained wholly in 7, then 
these fractions are identically equal inside the domain 7. 

Uniform convergence of the fraction [c,x/1]%,,. The uniform 
convergence of the fraction [c,x/1]>,, inside a domain T con- 
taining zero is sufficient for the uniform convergence inside T of the 
fraction K(x) = [¢,/1; ¢,x/1]}, after the possible exclusion of a 
finite number of points x’ of non-essential divergence. The fraction 
[e,/1; ¢,x/1]” is convergent here inside 7 to a single-valued 
analytic function K(x), regular inside 7, except at points x’, which are 
the poles of this function. 
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2. A necessary and sufficient test for the convergence of a 
continued fraction in which the partial quotients have 
positive terms (Seidel’s test) 


ce 
As has been shown, the divergence ofthe series } |a,| is necessary 


nel 
for the convergence of the fraction [I/c«,]>°. Seidel, and independ- 
ently Stern, showed that if all the terms of the partial quotients of 
the fraction are positive, the divergence of the series is necessary and 
sufficient for convergence. 

ExaMPLeE 17. The continued fraction 

ee ee 
24+24+2+... 
is convergent by virtue of Siedel’s test, since the series 2+2+... 
is divergent. 

Notice that the convergence of a continued fraction in which the 
partial quotients have positive terms depends on the divergence of 
a certain series, i.e. the behaviour of the entire set of terms of the 
partial quotients, not on the behaviour of each of them. A convergent 
continued fraction in which the partial quotients have positive terms 
is therefore unconditionally convergent. 

On passing from a continued fraction of the form (5.6) to a con- 
tinued fraction of the general form (5.1), the following statement of 
Seidel’s test is obtained; this statement was proposed by Stern. 

The divergence of at least one of the series 


© Ayay... Bont p Ss 2g +++ don (5.21) 

ne py... Gon Py 413 --- Gon41 ate 
is necessary and sufficient for the convergence of the continued fraction 
(5.1), of which all the terms of the partial quotients are positive. 


3. Tests sufficent for the convergence of continued fractions 
in which the partial quotients have positive terms 


Establishing the divergence of one of the series (5.21) is usually 
fairly difficult in practice. Thus it is often more convenient to make 
use of various tests which are sufficient for the convergence of conti- 
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nued fractions with partial quotients having exclusively positive terms, 
Some of these tests are given below. 


1°. Divergence of the series ¥ (b,_1b,)/@, is sufficient for the 
-n=2 
convergence of the fraction (5.1) when the partial quotients have positive 
terms (Stolz). 
2°. Divergence of the series ¥ VO yO n)/On is sufficient for 
n=? 


the convergence of the fraction (5.1) when the partial quotients have 
positive terms (Saalschiitz and Pringsheim). 
3°. Divergence of the series 
| a 
n=2 ay 
[+ 
by15n 


is sufficient for the convergence of the fraction (5.1) when the partial 
quotients have positive terms (Arndt). 
Notice that, if 


then 


Hence all the tests for convergence of continued fractions in which 
the partial quotients have exclusively positive terms may readily 
be extended to continued fractions in which all the partial numerators 
are positive and all the partial denominators negative. 


4. First set of tests sufficient for convergence 


Let the numbers r,, 7, ... satisfy the following conditions (Scott 
and Wall), 


1 nll+e] = lel, 

2) re [1Ltcotes| = les, 

3) Trl L+en tenga] 2 laln—2leni+ | enas! (n= 3), 
4 r, 290 (n = 3), 


(5.22) 
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where Co, ¢3,... are the partial numerators of the fraction 


_1 & 6 Ch 
aise Wg es (5.23) 


If the series ¥\ ryrg...1, is convergent, then the fraction (5.23) 
n=1 
is convergent, while 


[Kl st Sorry eset (5.24) 
n=1 


If the numbers r,, r2,... satisfy conditions (5.22) and at least one 
of the c, is zero, the fraction (5.23) is convergent. 

If c,, c,,... are functions of several variables, the above converg- 
ence test takes the following form. If the numbers r,, r,,... satisfy 


conditions (5.22), and the series }\ ryrz... 1, is convergent on a set E, 
n=l 
the fraction (5.23) is uniformly convergent on E, inequality (5.24) 
being satisfied. 
In particular, the set E can be chosen on the basis of the following 
theorem due to Scott and Wall: 


The set of conditions 


Paa-l 


>1, len| Ss 
a nl Pn-1Pn 


(n= 2,3,...) (5.25) 


where py, Pz are the terms of some numerical sequence, is sufficient 
for uniform convergence of the fraction (5.23) and for the following 
inequality to be satisfied: 


Kis Pe [ieee ee, 5 
1 1+ FG DD. aD 


Inequality (5.26) becomes equality if c, = (l1—p,)/p,_.P, (n = 2, 
Syne); 
If p; = 1, Scott and Wall’s theorem takes the following form. 
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The following conditions: 


Q) p= 1; 
Pa 1 . 
ss 12, By) 34 
(2) [ep | pas (n ) 
(3) the series > (Po—1) 3-1). ++ @azi—1) is convergent; 


n=l 
are sufficient for the uniform convergence of the fraction (5.23) and 


for fulfillment of the inequality 
|K] S1+ 2 (Pa~ 1)(ps— 1). -- Pngi— 1. 
n= 


This becomes equality if c, = (1—p,)/p,.P, (n = 2, 3, ...). 
In particular, of p, = (2n+1)/+k), the following theorem is 
obtained, by virtue of (5.25) and (5.26). 
The condition 
n*—(k—1)? = 
ar a a (n = 12) Os ie ) (5.27) 
is sufficient for the uniform convergence of the fraction (5.20), while 
we have: when k # 2, 


len| S 


3 1 
IX] 357% Ty pee qalce oe) 
wa lak DEK" nek 


An investigation of the series in the denominator on the right-hand 
side of the last inequality shows that the series is convergent for k > 1 
and divergent for k = 1. In addition, it follows from inequality (5.27) 
that -—1< <3. Hence, when —1<k 3 | (5.28) takes the form 


Kis 5) 6.29) 


and only retains the form (5.28) for 1 < k <3. 
Vorpitskii’s test. When k=1/2, we have p,=2. In this case 
(5.27) takes the form 


1 


Tt (m7 = 2, 3,...), (5.30) 


lenl Ss 
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while | K| = 2 in accordance with (5.29). But we can replace (5.29) 
by the stricter inequality: 


ee eg (5.31) 


4 
3 


VAN VLECK’S THEOREM. The condition 
OB 88 (n = 2, 3,...) (5.32) 


is sufficient for the fraction K =[1/l, c,z/1]7 to be convergent in 
the circle |z| < 1/4g to a regular analytic non-rational function, which is 
also equal to the series corresponding to this fraction, while | K— 
~ 4/3] = 2/3. 

The proof of this theorem follows from Vorpitskii’s test. 


5. Tests for the convergence of continued fractions periodic 
in the limit 
The fraction [a,/b,]”, for which a, # 0, lima, = a, lim b, = b, 


v—> oo var co 


is described as periodic in the limit. Such fractions are of great practical 
importance, since they are connected with the expansions as continued 
fractions of a large number of commonly encountered functions. 
The convergence tests for continued fractions periodic in the limit 
follow from the theorem: 
The condition lim sup {|c,|} S$ g is sufficient for the fraction 


vp oo 
Cy, yz 1° 
[4 ; =| (5.33) 


2 


to be convergent in the circle |z|< 1/4g (excluding possible poles) to a 
regular analytic non-rational function, the poles of the latter being 
the points of non-essential divergence of the fraction. In a neighbourhood 
of zero this function is equal to the series corresponding to the continued 
fraction (5.33). 

Having chosen as the g in this theorem any positive number, as 
small as desired, we pass to the following theorem. 

The condition lim c = 0 is sufficient for the fraction (5.33) to be 


Bmp oo 
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uniformly convergent in any finite domain of the complex plane, excluding 
a finite set of points of non-essential divergence, to an analytic function, 
which is regular in a neighbourhood of zero, and is regular in the re- 
mainder of the domain except for the above-mentoined points of non- 
essential divergence of the fraction, these being the poles of the func- 
tion. The point z = © is essentially a singular point of the function. 


To generalize this theorem, we assume that lim c, = c # 0. We 
v—> oo 
thus arrive at the following theorem. 


The condition lim c, = c 4 O is sufficient for the uniform converg- 


—> co 


v 
ence of the fraction (5,33), excluding a finite set of points of non 
essential divergence in any domain T < T, where T is the complex 
plane with a cut along the real axis from the point (—1/4c, 0) to an 
infinitely remote point, such that the cut does not pass through zero. 
If the cut starts from zero, the following Stieltjes test holds. 
Suppose the following conditions are satisfied: 


(1) 4, @,... are real and non-negative; 
(2) &, %,---s%angq.--- are not all zero; 


(3) the series ) x, is divergent. 


k=l 
Then the fraction (z/x,]"° is uniformly convergent in any finite 
domain lying inside the complex plane, cut along the negative part of 
the real axis. 


§ 3. The expansion of certain functions as continued 
fractions 


1. Lagrange’s method 


Lagrange proposed the following method of solving differential 
equations with the aid of continued fractions. Suppose we have a 
differential equation in y and x, and assume that y ~ &, when |x| ~ 0. 
We now puty = &)/(i+y,) and substitute this relationship into the 
original equation. We obtain a differential equation in y, and x. 
Suppose y, ~ §, when |x| = 0. We put y, = é,/(l1+y.) and repeat 
the process. All in all, we arrive at the solution of the original 
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equation in the form of the continued fraction [€,/1]>°; &, is more 
conveniently sought in the form a,x"*, where v, = 0. 

Many differential equations can be solved by this means, but it 
generally proves difficult to find the dependence of £, on the index 
n, ie. to find the general partial quotient of the continued fraction. 


2. Fundamental differential equation 


Let us apply Lagrange’s method to the equation 
(@ta'x)xy' + (B+ Bx) + 7" = bx, yO) = 0, (5.34) 


Having put y = dx/(«+8+y), the equation is reduced to the 
form: 


(@ +a'x)xy' + [e+ B-(o' +B xi +¥2 = [@ + BY’ +P) +7 8)x. 
On repeating this process, we get the continued fraction 


dx [@+B)@'+P)+78)x  (ea’- af +a'h + yd)x 


y= 


a+ B+ 2a+B + 3a +B +e 
[x +B) na' +B) +78) |x _(Pacce’ — neacB’ + na’B + y6)x 
sot 2nx +B + (Qn+1)2+B +... 


It is readily seen from this that the differential equation 
(a +a'x®)xy'+(B+P'x®)y+yy? = dx4, 0) = 0 (5.35) 
has the solution 
ee x* [(koc + 8) (kee +B’) + pd)x* 
kat B+ ka +B + 
(kccoe! — kx B' + ka'B - yd)x* 
+ 3ka + B toe. 
[nko +B) (nkex’ + B’) 4 yd]x* 
a danke +B + 
(P2200! — nkaB’ + nka’B + yd)x* 


+ (Qn + Ika +B pica Oe) 


Almost all the differential equations, the solutions of which were 
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expanded as continued fractions by Lagrange, Euler and others, are 
particular cases of equation (5.35). It is therefore natural to refer to 
(5.35) as the fundamental differential equation. 


3. The expansion of a power function as a continued fraction 


Let us put y = (1+ x)”, where v is any real number. Then (1+ x)y’ = 
=vy = vy, y(0) = 1. On putting y = 1+»x/(1+z), we reduce the 
differential equation to the form 


(1+x)xz'+[1-(—»)x}z +22 = (1-»)x, 2(0) = 0. 
This is a particular case of equation (5.35), in which 

kKea=ze’=Pay=1, Pf =-—-(l-»), d=1-». 
We thus have, from expansion (5.36): 


vx (l-»)x (1+)x 
t+ 2 + 3 + 
(2—»)x (n—v)x (n+v)x 
cnn? aan Corerwrees i le 7) pl Qe re 


(1 +x)" es 


(5.37) 


This expansion was obtained by Lagrange. In view of the above- 
mentioned convergence tests, it is convergent on the complex plane 
cut along the real axis from x = —o tox= —l. 

The power series into which the function y = (1+x)” can be 
expanded is convergent in an open circle of radius 1 with centre at 
the origin. The expansion of the function y = (1+.)” as a continued 
fraction is therefore convergent in a much wider domain than the 
expansion of the same function as a power series. 

EXAMPLE 18. On putting x = 1, » = 1/3, we have 


5 3n—1 9 3n4+1 
+24...+¢ 2 4+32n+I)+... 
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On contracting the expansion (5.37) in accordance with formula 
(5.9), we get 


= 2x (1—+*)x? 
CaS ttS Ga Oa = 
(4—9)x2 (2-— 9)x2 
Fas) iin eee as 


This expansion is convergent in the same domain as the expansion 
(5.37). 

Irrational square roots may be expanded as continued fractions 
by means of the following elementary method. 


Let Vx wa. Then J/x = a+(Jx—-a) = a+(x—a®)/(a+ Vx). 
Consequently, 


ecaca x-a x—a* 
EE Og ALT Di sie 


This expansion is convergent on the complex plane, except the nega- 
tive part of the real axis. 


4, The expansion of a logarithmic function as a continued fraction 
Expansion (5.37) can be put in the form 


d4+xy-1 


r 


(-—»)x (+x Q- x 
+ 2 + 3 + 2 
(24+ 9)x (n—v)x (1+P)x 
pS ae ree Sy ae ie) ee er 


_* 
~~ 


On setting » = 0, we obtain, since lim [(i+x)’—1]/y = In(1+x): 
v—>+o0 
x xX x 2x 2x nx nx 


WEST EET ee as a en ee (5.38) 


This expansion and the method of obtaining it from expansion (5.37) 
were found by Lagrange. Expansion (5.38) is convergent on the 
complex plane cut along the real axis from x = —o tox= —l. 
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EXAMPLE 19, On putting x = 1, we have: 


in2=2 1 i n n 
BET ORS Ky tO page he 
Pi 29 
TT 3 10 


5. The expansion of an exponential function as a continued fraction 
On replacing x by x/», expansion (5.37) takes the form 
l-» l+rv 2-9» 


v x ———X x 
(gy Se 
vy) 1+ 2 + 3 + 2 + 


+ 5 +...¢ 2 + dngl +... 
On letting v tend to <o, we obtain in the limit: 


x x x x x x 


x 
ple Se a ea tc, ec ee a, ee 


(5.39) 
This expansion is convergent on the entire complex plane. The expan- 
sion and the method of obtaining it from expansion (5.37) were 
discovered by Lagrange. On contracting the continued fraction 
(5.39) in accordance with formula (5.9), we arrive at the expansion 
obtained by Euler: 


2x x2 x x? 


= Maa 6 S102 ee Sy en be ae 


This expansion is also convergent on the entire complex plane. 


6. Expansion of the function y=arc tan x as a continued fraction 


The differential equation for this function has the form 
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On setting y = x/(1+2), this equation reduces to the form 
(1 4 x*)x2’ + (1—3%)2+2? = 2% 
This is a particular case of equation (5.35), in which 
e=e@sfPoy=6=1, P=-i, k=2. 
We therefore have, from expansion (5:36): 


x Ax? 93? "rex? 
$3454 74... +2n4¢14...° 


x 


arc tanx = 
1l+z 


= + (5.40) 
This expansion was discovered by Lambert (1728-1777). It is conver- 
gent on the whole complex plane except for two cuts along the imag- 
inary axis from —o ito —i, and from ito +i, This expansion 
is thus convergent in a far wider domain than the power series into 
which the function y = arc tan x may be expanded (this latter series 
is convergent inside the unit circle with centre at the origin). 

The terms of the partial quotients of fraction (5.40) satisfy condi- 
tions (5.14). We can thus obtain a further expansion of arc tan x 
on the basis of equation (5.15): 
x8 9x? 4x? (2n+1)%x2 — (2n)*x* 


BLO ASS a Eg al 4nt+1 + 4n¢+3 +...° 


x 
7. Expansion of the function y =| dtj(i+t*) as a 
continued fraction S 


The differential equation for this function has the form 


Le 1 ae: 
Y= Tp y(0) = 0. 


On putting 


Sls 
y= Tye 


the equation reduces to the form 


(1 +-x*)xz' +(1—x*)z 4 22 = xk, 
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This is the particular case of equation (5.35) wheng =a’ =P=y= 
=6=1, f’ = —1, k is any number. We therefore obtain, from 
expansion (5.36): 


142 +k+142k+1+ 3k4+1 +... 


mkaxk (nk + 1)?x* 
wee $ Qnk +14 QntDke+1 4..0° 


Q 


f dt _ x xk kek (ik + 1)?x* 
mo 
(5.41) 


This expansion was obtained by Lagrange. It is convergent on the 
plane of the complex variable x*, cut along the real axis from — oo 
to —1. When k = 1, expansion (5.41) becomes the expansion for 
In(1 +x); when & = 2, it becomes the expansion for arc tan x. 


On substituting x?*+} for x in the integral | dt/(1+¢*) and setting 
0 
k(p+1) = q, we obtain from (5.41) the expansion 
=P dt — xPtl (p+)Pxt gxt 
o ite” prl+gtl+pt Wg+lep+... 


werd (nq +1-+4p)?x4 


see 5 NE . (5.42 
---+2nqgt+l+p+(Qn+)Iq+l+pt+... Cw) 


For example, 


zd 19 16 49 16 (4n +3)? 

og itt 347 +114 15 +...4+ 8743 + 8nt+7 +..." 
O01 7 93 1738 
T3 30 378 7i 


On using conditions (5.14) and equation (5.15), we can write (5.24) 
in the form 


ede xPtl PHT (gg 1 t+ p)Pxt 
ee “pel grlap+ 2g+itp 
qrxt (nq +1+p)?x4 n2g?x4 
+ 3¢+it+p+...+ Ingtl+p +(Qn+Dqtl+pr...’ 
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For example 


1d 1 1 49 16 (4n+3)? 16x? 
1424030 7 +1 + 15 +... + Bet? + 87474...° 
1 4 93 1459 
3 27 «378 6006 


8. Expansion of tan x and tanh x as continued fractions 


The differential equation for y = tan x is of the form 


y=lt+y, 0)=0. 
On putting y = x/(i+z), this equation reduces to 
xz tzt¢2= — 3%, 
This is the particular case of (5.35) whena’ = Bf’ = 0,2 =B=y= 1, 
6=—1, k =2. We thus obtain from expansion (5.36): 


x x% x2 xt 


ba eal ee Ne TE Pee 


(5.43) 


This expansion was discovered by Lambert. It is convergent on the 
whole plane of the complex variable x, except for the points at which 
tan x becomes infinite. 
On replacing x by x/i in expansion (5.43) and multiplying the 
resulting equation by i, we obtain 
x. (3 9? x 
Ey Fa 5 at. On aa Cw 


9. Expansion of Prima’s function as a continued fraction 
The integral 


{ 19-1 e-t dt (a> 0, x> 0) 
x 
is known as Prima’s function. Let us introduce the function 


y= wove | fo-le-t dt, 


x 
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which satisfies the differential equation 
xy’—(l-a+x)y = —x. 
On putting x = 1/t, » = 1/(1+w), this equation takes the form 
ty’ +[1-G—a)tlu = (l—a)t, u(0) = 0. 
This is the particular case of equation (5.35) whena = 0,k =a’ = 


=fB=y=1, f= -(i-a, 6=1-4. We thus obtain from 
expansion (5.36): 


_G-at ££ @-a at (n+l—ayt 
~  L -l- 1 +...¢ b+ 1 sre 
On returning to the original notation, we get 


Gata: So l-a A. 2-—a 
x “x + Lo txt To 4... 


u 


eee a els PP} 


On contracting this expansion on the basis of formula (5.9), we get 


hae jorterlges x7e-* l-—a 2(2—a) 
x+l—-a—-—x+3-a—x4+5-a-..., 


n(n — a) 
.e— Xt Antl—-a—...° G0) 


= 
We call | (e'/t) dt the integral exponential function and denote it 


by Ei(x) (see (6.393)). We obtain from expansion (5.45) with a = 0 
and x <0: 
: 1 i 1 n on 
= efi Pak See og aa 
Bo)= (FS Te... THF OM 


The function 


is called the integral logarithm and is denoted by li(x) (see (6.394)). 
We obtain from expansion (5.47): 


x13 


cle lak rage et = ee 
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10. Expansion of the incomplete gamma function as a 
continued fraction 


To obtain an expansion of the incomplete gamma function, i.e. 
of the integral 


{ “ye-le-t dt = (a > 0), 


0 


we introduce the function 


poe [ -le-tdr (x > 0), 
0 


which satisfies the differential equation 
xy'+(a—my-1=0, y=. 
On putting y = 1/(a+y,) in this equation, we get 
XV, +(@4+x), 495 = — ax. 


This is the particular case of equation (5.35) whenk =a = fp’ = y=1, 
a’ =0, B =a, 6= —a, We thus have from expansion (5.36) 


= x%e-* = ax x (l +a)x 
a=lp—t = —_-  —_— 
[i Gee eg eee Da ae 
2x nx (a+n)x 
+4+4a—...+2nta—2n+lta+...” 


11. Thiele’s formula 
The Taylor series 
h 77 P ae he (n), 
f+h) =fO+ TG fO+T Lest --- +a PM) +. 


corresponds in the theory of continued fractions to Thiele’s formula 


h h h 


Seals FO) + 55 4 fe) + 3rref(x) +... 


h 
we EMT yy f(X) tee! 
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Here r,, f(x) is called the inverse derivative of the n-th order of the func- 
tion f(x). The inverse derivatives are defined by the relationships 


108) = sree tafe) = 0s) +27 fl, 
and in general, for n = 2, 

InJ(x) = Tn—al (x) + nrry_i f(a). 
For example, 

re™ = e-*, ree* = —e*, 1.4, Fone™ = (— 1)", 
Tonge = (—1)"@ + le*. 
Hence 
(20+ Drrene® = (— 1)" (Qn + len*, 

(2n + 2)rrengie* = 2(—1)"*1e*, 
If we use these relationships and replace x by 0 and A by x in 
Thiele’s formula, we again arrive at expansion (5.39). 


Thus Thiele’s formula is another source of obtaining the expansions 
of various functions as corresponding continued fractions. 


12. Fractional approximations for sin x and sinh x 


The general form of the expansion as a continued fraction of sin x 
is not known. Only a finite set of partial quotients of the expansion 
can be found by Viskovatov’s method. For example, 


nek 2 Ust sss 
I+ 6 —- 10 + 98 — 198 +... 
x 6x 60x — 7x3 5880x — 620x3 
TY 64x? 6O43x* 58804 360x? + 11x! 
and 
en ae ust 5x 
6 + 10 - 42 + 66—...° 


x 6x—x* 60x—7x3 2520x—360x9 + 1125 
T 6 6043x 2520 + 6052 
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It follows from the approximation 


60x — 7x? 


60 + 3x? 648) 


sin x ~ 


that sinz/4 ~ 0-7071, if we put 2/4 ~ 0:7854. Hence, in view of 
the periodicity of the function y = sinx and the relationships 


nape : wei 
sin ae =cosx and cosx = /1]—sin? x, the approximation 


(5.48) enables four-figure tables of this function to be evaluated with 
the aid of a calculating machine. In the same way, by using the higher- 
order convergents, we can evaluate tables of y = sin x with any num- 
ber of correct decimal places with the aid of a calculating machine. 

Since sinh x = —i sin ix, the expansions obtained for sin x lead 
us to the following expansions for sinh x: 


we ee x? 1x? 112 551x? 
SOB TSS ee Ge AO) Ge OR I ay 
x 6x 60x — 7x3 5880x +-620x3 
T 6—x2 60—3x? 5880—360x+ lix? 
and 
sinhx = x a cas acs 2a 
SE GS 0 Wy S66 Baas 


x 6x+29 60x47x% 2520x4+360x? + 11x 


I 6 60 — 2x? 2520 — 60x? 


13. Fractional approximations for cos x and cosh x 


The general form of the expansion as a continued fraction of cos x 
is unknown. Only a finite set of the partial quotients of the expansion 
can be obtained by Viskovatov’s method. For example, 
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cos x = ee Le ey ae 
t+ 2 - 6 4+ 50 —- 126+... 
1 2 12— 5x 600 — 244? 
1 24x? 1242% 600+56x7 + 3x4 
and 
cosx = 1— = = = a 
a 2+ 6 —- 10 +126-—...° 
Lo o2-x? 12—5x* = 120—56x?+3x4 
1 2 12+? 120 + 4x2 


Since cosh x = cos ix, the above lead to the expansions: 


2 5x2 3x2 313x2 
2 


oie 2 = — 
=e + 6 - 50 + 126 -... 


i 2 12 +5x? 600 + 244x? 
1 2-x® 12—x% 600— 56x? +. 3x4 


and 
cosh x = 1 + = ca = 1328 
a 2- 6 + 10 — 1264+ ...° 
1 24x%  1245x? 120 4. 56x? +. 3x4 
T 2 12—x2 120— 42 


14, Fractional approximation for the error function 


The general form of the expansion as a continued fraction of the 
x“ 

error function erf x = (2//x) e~" dt is unknown. Only a finite 
Q 


set of partial quotients of the expansion can be obtained by Visko- 
vatov’s method. For instance 


Seo ca 3922 739x2 
rd “T+ 3 - TO + | ey Le eee 


x 3x 30x — x8 210x + 110x? 
1 34x 3049x? 210+ 180x? + 39x4 
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15. Conversion of Stirling’s series into a continued fraction 


Let us take the Stirling series (see (6.509) and (6.516)): 


InI(x) = (=-z) in xox4+y In dnt J(x), 


where 


of RE, Be Bun 
IQ) = a3 t+aget + Gacieeeit 


. 


and B,, By, ... are Bernoulli numbers (see Chapter VI, § 2, sec. 1, 
1°): 
1 1 _ i ee 5 


6° B= ~~ 39 = 


B, = ~ 30° Bro = 


By using Viskovatov’s method, we can convert the Stirling series 
into a continued fraction, the general partial quotient of which is 
unknown: 


2 2 


1 2 53 1170 22999 
+12x+ 5x+42x+ 53x + 429x + ...° 


In I(x) = (-z) ieee In 2x + 


16. Fractional approximation for the gamma function 


If we evaluate the coefficients in the expansion of the gamma 
function: 


F0d+x) = 5 Cnx"s 
n=0 


1 oo 
CES ee 1)ep_ pS, 5, = Py 


5, = C = 0°57722 (Euler’s constant, see (6.56)), we obtain approxi- 
mately: 


P+ x) = 1—-0°57722x +0°98906x?_ -0°90748x3 +. 0-98173x4— ... 
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On applying Viskovatov’s method to this approximation, we obtain 
in particular: 

140°15141x +0°24392x? 

PU+%) © 797m 63x—052456a8 — TO) G#) 
This approximation is sufficiently accurate in many cases, as is 
clear from the following table: 


x PU+x) T(x) x F+x) T(x) 
-0°5 17725 17767 O1 0-95135 0-95135 
-0-4 1-4892 1-4902 0-2 0-91817 091816 
-03 1-29806 1-29823 0:3 0°89747 0-89743 
0-2 116423 116425 0-4 0-88726 0-88711 
—O1 106863 1-06863 0-5 0-8862 0-8858 

0 iL. 1 0-6 0-8935 0-8927 
0-7 0-9086 0-9071 
1 1 0-994 


17. Fractional approximation for the logarithm of the gamma function 


Approximation of this function on the basis of Stirling’s series 
requires a knowledge of In x. However, it is possible to obtain a 
simpler approximation by starting out from the expansion 

eo (_])ryn 
Misa) Sere Fhe ee (5.50) 


n=a2 n 


oo 

where s, = ) 1/m", C is Euler’s constant. On evaluating the 
m=1 

coefficients, we obtain approximately: 


In (1 +x) =~ ~0°57722x +.0°82247x? — 0°40068x5 + 0:27058x4—.... 


On applying Viskovatov’s method to this approximation, we obtain 
in particular: 
— 0°57722x + 0:59769x? 
1 +0°38941x — 071392822 * 


InI(1+x) ~ 
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Hence 


— 0:25068x + 0°25957x2 


lePU+%) © 77939042 — 013922 


=T(x). (5.51) 


The accuracy of this approximation is clear from the table. 


x lg T(1+x) T(x) x Ig T(1+x) T(x) 
05 0-2486 0:2469 0-4 197834 197834 
0-4 01730 . | 0-1725 0-2 196292 196293 
-03 0-11329 0-11321 03 7-95302 195305 
0-2 0066039 0066029 0-4 1-94806 }-94818 
-01 00288268 | 0-0288266 || 0-5 T9475 19479 

0 0 0 


18. Fractional approximation for the derivative of the 
logarithm of the gamma function 


In accordance with (5.50), the function 
Po) = A490 
dx 


has the expansion 
Wx)= —C45x— sgt... +(— 1545x400, 
from which it follows that 
Wx) = —0°57722 + 1°64493x — 1:20206x? + 1-08232x5— .... 


On applying Viskovatov’s method to the last approximation, we 
obtain in particular: 


— 0°57722 4- 1:25687x 


TEOCTRe—O16eTO® = 7H): (5.52) 


W(x) = 


The accuracy of this approximation is clear from the table. 
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x P(x) T(x) x Px) T(x) 
-05 1-964 1-938 O-1 ~0-4238 ~—0-4237 
-0-4 1-541 ~ 1-538 0-2 —0-2889 —0-2890 
0-3 1-225 —1-218 03 ~0-1692 —0-1687 
0-2 —0-9650 —0-9647 || 0-4 —0-0614 —0-0600 
—O1 —0-7549 ~0°7549 || 0-5 0-0365 0-0396 

0 —0-57722 —0,57722 


19. Obreshkov’s formula 


A knowledge of the general form of the partial quotients of the 
continued fraction into which a given function can be expanded is 
not sufficient for a determination of the general form of the conver- 
gent of this expansion. Nevertheless, the general form of the conver- 
gent can be found in certain cases. The most general approach to 
this problem uses Obreshkov’s formula, which is one of the general- 
izations of Taylor’s formula. Obreshkov’s formula is 
7 (- oe (x— Hoy ete fF OKx) = eee Ch 


ved vad Cricg. m+k 


‘ (x1 (xy— DE FENN dt, (5.53) 


@- ny" Of 5) 


ea 


Determination of the rational fraction approximations of a power 
' function with the aid of Obreshkov’s formula. We put xy = 1, f(x) = x" 
in (5.53), being any real number. Now, 


m CrCY 
xh x smo Chik as 
we Cecz (x—1)¥ * 
—1y~ 2 
3 ) Chk x 


When m = k, this equation becomes 


k yy 
5 CECE (x1) 


=o — 
EG yp AE (— ly? . 


Cop =o 
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In particular, when k = 1, 


2—n+nx 


Pines, ee ee 
aS n+(2—n)x a 


For instance, when x = 2 and n = 1/3, we have V2 14/11 x 1-273 
(the accurate value is 1:2599. . .). 

Determination of the rational approximations of the exponential 
function with the aid of Obreshkov's formula. We put x, = 0, 
JQ) = e& in (5.53), Now, 


In particular, when m = k, 


2KM—1), .. (KAN HCL AK=A1) ... (Det CR(2R— 2), UE WATE LXE 


~ Fee). (REICH 21)... (+ D+ CH(2k 2), . (e+ Dat. (Da 
(5.54) 
Using the relationship 
tanh x = athe 
e+] 


together with (5.54), we get 
Chk=1) (2k—2)... (k-+1)x~C 82k —3) (2k=4)... (kb 14x38 + 00. 
KQQK—1) RAD RACHA CHD Dem (EEE MaMa). kb NBA... 


tanh x = 


On replacing x by ixin the last equation and dividing the right-hand 
left-hand sides by i, we get the general expression for the convergents 
of the expansion of tan x as a continued fraction. 

Determination of the rational fraction approximations of the 
logarithmic function with the aid of Obreshkov's formula, We put x)>=1, 
Six) = In x in (5.53). Now, 

cy (x 1y Ps Ce (x—-ly 


™m 
Inx + -iy i * 
- of ) Chik y oH Chan x” 


In particular, when m = k, 
k py —1y 
Inxs »y Ce eae eee 


151 Ch, x ” 
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For instance, when k = 1, 


When & = 2, 
x1 


Inx ~ Tat 


(8x—x?- 1) 


§ 4. Matrix methods 


1. Extraction of the square root by means of second-order matrices 


The theory of continued fractions is built up with the aid of the 
fundamental recurrence relations (5.2). It seems natural to consider 
generalizations of continued fractions, based on other linear recurrence 
relations, connecting the numerators and denominators of neighbour- 
ing convergents. Let us consider in more detail the relations 


Py = Pai tPnrQn—1s 


= al ae ea 5.5 
On = YnPn—1t OnQn-1» } Ms ) 2) 


These equations can be written with the aid of matrices in the form 


Py 3 an Ba Pri Pay 
8 = C ‘alge (n=1,2,...). (5.56) 


We put «4,=4,8,=u4u,y,=16,=a(n=1,2,...). Relations 
(5.55) and (5.56) now become respectively 
Py, = GPy_y+uQn-i 
On = Pair t+aQn_1 


Pa _ {a 4 Prat ac 
()-( G2) ene os 


When a = 0, the process (5.57) is divergent. We shall therefore 


assume that a = 0. If lim P,/Q,, exists, it can be equal either to Ju 
n> oo 


} (n=1,2,..) (5.57) 


and 
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orto — Ju. Consequently the process (5.57) is divergent when a < 0. 
Let us use the notation 


— fu = x, Ju = xp, 


We now have four cases: 


P. 
la>x, m»<~<—'; 
aia aN a 7 
2) O<a<x%; lim =" = xg; 
n+ Yn 
Prone Pon Pongt Pont ‘ 
- << Xx. sex SS; 
Omas Orn” Oras Dana 
3) x, <a<0, 
Poni Pansy Pan Pon—2 
we oo Yr << te 
Qen-1 Dona "Orn Qon—2 lim Pa = X4: 
P. P. nao Un 
)a<x, So <2 <x; 
On-1 Th 
For example: 
1) a> x, 
5 22) 5 47 455 4409 
1 5) 1 10 97 940 
5 47 4-6907 4-69043 
/22 < 4-69043; 


2) Ox<a<%, 
5 27\ 5 52 26 265 2702 1351 
1 7° 5 SI 520 260 


I 
5 52 519607  5:19616 
5-19607 < ./27 < 5-19616; 


3) x»<a<0, 
~1 2-1 3 =7 W —41 
( 1 a7) ee ee 
—1 -15 -14 -1:416 -—1:4137 
- 1416 < —/2 < —1-4138; 
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Na<x, 
(4 3) So ea. 
1-2) 1 =4 15 — 56 
—2 ~1:75 —1-734 —1-73214 
~1-73214 < —./3. 


2. Solution of quadratic equations with the aid of 
second-order matrices 


Let us puta, = a4, 2, = —4, Yn = 1, 6, = @+p in (5.55). Relation- 
ships (5.55) and (5.56) now become 


Py = @Py_1—GQn-1 \ 
On = Pa-it(@t+P)Qn-1 


(e)"(ee les) 
Qn la+p/\Qn-1 
If lim P,/Q,, exists, it can only be a root of the quadratic equation 


noo 
x24 px+q = 0, Consequently, when p?—4g < 0, the process (5.59) 
is divergent, since the roots of the quadratic equation are complex 
in this case, while a sequence with real terms cannot have a complex 
limit. 

Let us write 


En ee ee 
= i ro 2 . 


(5.59) 


and 


xy 


When a = (atx), the process (5.59) is divergent. When the pro- 


cess is convergent, we have four cases: 


P. P, 
1) a> Xo x. a a, Cs SE : 
BRED Ona 
2 BE ca<m, lim = = x; 
2 n> oo Un 
Pon—2 Pan — Ponti — Pani é 


Oncy  Osge Omy  Oimck” 
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3) xy <a< at Xa 
2 
Pon—1 Panst Pan Pano P. 
<< X< =. lim —* = x 
Qon-1 Qon+1 s Qon Con Nh—> con . 
4 a<x, fig oat X43 
Qn-1 nm 
For instance, the equation 
x2+2x—-1=0 


has the roots 


Xp = —14J2 -or xx 2414 and x, x 0-414, 


1) a> xy, 
jo agt f EY eee “ay 10. he 
“ON. 3/7 @° 2 F 24 32? 
1 05 043 0-417 
2) PU ca ghee. 
2 
-o (21 2 5 
came (ero ak ey Sm 
0 0-5 0-40 0-417 
3) x <a< Mit %e 
2 
Lugs (2 VSP SEB 2, 
Rae 10) 1 =32 7S —12’ 
—2 -25 ~—240 —2-416 
4 a=< x, 
eng fptee INES AO. Bie Gt SRY 6 8 
BS it ap ie Ee ee Oe eae 


-3 —2:5 — 2-428 — 2-416 
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3. The connection between matrix methods and the theory of 
continued fractions 


Let us find the conditions under which the equations (5.55) can turn 
into equations (5.2). For this, we replace » by n—1 in equations 
(5.55), find O,., and P,_, from the relationships obtained, and 
substitute them in equations (5.55). On introducing, for brevity, the 
notation %_, 5,_1:—Bp_in-1 = An_p We get 


P= (=+ fe Pa ~Parass Pro (5.61) 
nok n—1 
and 4 
2 
2, = = opart bn 0,421 Qn—2- (5.62) 
Yn-1 Yn-1 * 


Equations (5.61) and (5.62) show that P, and Q,, can be taken as 
the numerator and denominator of the mth order convergent of a 
continued fraction provided that 


Vn Bn Bn Vn 
—t ag téy = a by_1 +e, Re, (2 2 2). 
ti A Bn-1 ” ne Bnet Yn-1 


These conditions are readily written in the form 


On — 5y = Sn—-1— On-1 eS os a — Oy 
Bo i Bn (te 

5.63 
Ba Pat A 

Yn Vn-1 var 

Hence the matrix 
an Bn 

—6 5.64 
Ben ty — +B, ( ) 


is equivalent to a continued fraction, the partial numerators a, and 
partial denominators 5, of which are given by the equations 


a, = pe (Bn—aYn-1-%n-19n-D> On = cae Oy-1t+@n—1 (n= 2). 
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We can find from the relationships 
( )(o)= (2) =) 
Yo O/\0 Yo 1 
CG a ( - ee ) = Coo 
wy $6 1 Yibo + by 


the zero and first partial quotients of the fraction. Hence the matrix 


and 


(5.64), in conjunction with the matrix G a) , leads to the continued 
0 


fraction 


Bo 
= — 06. 
Oot 4% + Bi —%o(Mr%0+6) At (Bry. ae) 


—6. 
no + Fi, + eles 
Bn = é 
B, (Bn—1Ya-3 Sy—y in —1) 
a (5.65) 
weet B,_, ona tn Hs ia 
ne 


EXAMPLE 20. The matrix ( ) leads to V2 and is equivalent to 


the continued fraction 


1 1 1 
J2=14+- — <= 7 
40 Lee eal 


In the theory of continued fractions, contraction is performed with 
the aid of the fairly complicated formula (5.9) and analogous formu- 
lae. Here, it is performed much more easily, with the aid of squaring, 
cubing, etc., the matrix. We have: 


1 2\/1 2\ (3 4 
— : =2-4-3.3= — ; 
(; OG | ( 3) Se ee ad 


b, = 343 = 6 (n = 2). 
The zero and first partial quotient of the new continued fraction have 
to be found directly, and not on the basis of this matrix, from a 
knowledge of the first convergents of the initial expansion for ¥/2. 
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We get 


2 1 1 
Cag Gey 


On using the cube of the initial matrix, we get 
3 4\/1 2 : 7 10 
23/\1 1) \s 77’ 


V2 =1 De dhe at 
Hegel 


4. The reduction of quadratic surds to non-periodic continued fractions 
by means of second-order matrices with variable elements 


The results of the previous section enable us to obtain as many 
expansions as desired of irrational square roots as non-periodic 
continued fractions. 

EXAMPLE 21. The matrix 


(1 2+ 
(, +1 1 ) 
satisfies conditions (5.63). In addition, it leads to the equation 
Pa - Prat2a+YQn-1 
Qn (a + 1)Pa-1 +Qn-1 < 
from which it follows that lim P,/Q, = /2. The equivalent continued 


n—> oo 


fraction (5.65) has the form 
2 21 817 15.31 24.49 
Ve ETS oy oo ea a 
(7? ~ 1) 2n? — 1) 
re n+l He wcte 
Similarly, by starting from the matrix 


n An a 
ee n ‘4 


we get the continued fraction 


Vad 2 (? — 1) G#+2n-1) 
“T+ 7 +e... + Qn? —1 pees! 
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5. Extraction of the root of any rational power by means of matrices 


Extraction of the cubic root with the aid of matrices. Let us consider 
the three sequences {P,,}, {Q,,}, {Ry}, the terms of which are connected 
by the relationships: 


Pa = GPyi1+tQn it tRa_-v, 
On = Pa-1t@Qn-ittRn- (n= 1, 2,...). (5.66) 
Ry = Pay +Qn-1+4Rn-1 


These relationships may be written with the aid of matrices as 


Px at t) (Pr; 
QOnf= loa t)|Qna (5.67) 
Rn 11 a) \ Raa 
Let x =lim P,/Q, and y= lim Q,/R, exist and be finite. Now, 
N—> co n> co 


x= iff, y= Yi. 


EXAMPLE 22, Let a = 1, t = 2. Then 


12 2 15 19 73 281 1081 
112 1 4 15 58 223 858 
111 1 3 12 46 177 681 


4/4 approximately 1 1°67 1:°583 1-5870 1-58757 1-58737 
2 approximately 1 1-33 1-250 1-2609 1-25989 1-259912 


It is well known that 5/2 ~ 1-2599210, /4 = 1:5874011. 

By utilizing the square, cube or a higher power of the initial matrix, 
the convergence of the process can be strengthened as desired. 

Extraction of the fourth root with the aid of matrices. We generalize 
relationships (5.66) and consider the following equations: 


Qn = Pair tQn1 +t Rn_-i t tSn—1, 
Ry = PyeatQn-1+@Ry1 + tSy—1, 
Sp = Pai t+ Qn-1t Rn-1t@Sn-1- 


Pa = GPqyt+tOnu1 + tRnarttSna1, | 
| (n= 1, 2, ...). 


We can write these with the aid of matrices as: 
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Pr att t\ (Pay 
On) _Jl @ t ty}Qn4 
Ra 11a t]\Ryy 
Sn 111 a/ \Sy_; 
Now, 
tim 72 = 4B, tim 22 = = 7, tim 2a sf, 
no Sn Noo Sa nee Sn 


if these limits exist and are finite. When a = 1, we have the matrix 


1o¢ ¢ t\ 1 L43¢ 141243 143114+31°+8 
1i1o¢ f) 1 242 34121+2 44401 +2027 
1 11¢f 1 34t 6+10r 10+44¢ + 102? 
1liwuti 4 10+6¢ 20 +402 +427, 
Hence we can obtain in particular the inequalities 
12 412t+3 6t2 +10 
aio 2 V8 = wpiggs 1 StS) 
_6t7 +107 174 12t4-3 
fates 2V' = Gai C= 


The domain in which we can apply these approximations is clear 
from the following table: 


t24-12¢43 6t? + 10¢ 
6f+10 vt 2412643 
1 1-000 1-000 1-000 
2 1-409 1-414 1-419 
3 1-714 1-732 1-750 
4 1-971 2-000 2-030 
5 2-200 2-236 2-273 
6 2-413 2-449 2-486 
7 2-615 2-646 2-676 
8 2-810 2-828 2-847 
9 3-000 3-000 3-000 
10 3-186 3-162 3+139 
rst 3-368 3-317 3-266 
2 3-549 3-464 3-381 
13 3-727 3-606 3-488 
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Extraction of any rational root with the aid of matrices. It may be 


seen, on generalizing the method above described, that the nth-order 
square matrix 


enables approximate values to be obtained for 


For example, to evaluate V4, we only need to carry out the fol- 
lowing working: 


122 22 2 2) 1 «#13 «#127 
11222 2 2) 1 122 115 
1112 2 2 2) 1 11 104 
}lid412 2 2) 1°10 94 
2122112122 2) 1 °«9 = 8 
111,11 1 2] 1 8 7 
1112142121 3) 1 #7 7 


In particular, °/4 ~ 104/85 = 1-223 or 9/4 ~ 85/70 ~ 1-214. The 
accurate value of this root is 1:219.... 

The convergence of Euler’s algorithm. The method of extraction of 
roots of any rational degree with the aid of matrices was first pro- 
posed by Euler (though not in matrix form). The conditions for its 
convergence were recently obtained by L. D. Eskin. In particular, he 
showed that Euler’s algorithm is convergent for any r> 0 provided 
only that the zero approximation be chosen by a reliable method. 
Furthermore, Euler’s algorithm is convergent for complex t, which 
enables it to be used for approximate extraction ofroots of complex 
numbers. 
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6. Solution of cubic equations by means of matrices 


The matrix 
My, Ao As 
Gz, a2 a3 (5.68) 
931 Gs_ 33 
eads to the equations 


_ WX $42) +43 


2 = kt Aa Tas (5,69) 
AgyX + Ago) + G33 


ane Gg,X + Osa ¥ +233" 


On eliminating x from these equations, we arrive at a third degree 
equation in y. Consequently, the matrix (5.68) can serve, when the 
corresponding process is convergent, for approximate evaluation of 
one of the roots of a third degree equation. 

We can readily obtain from (5.69) the equations 


= 1 en a) ¥ + aa Sea)y + Ga3— 8 


? AgX + Asay + Ass 
ee ye (@y = Gy) * + Qa — aa) V + 413 — Ses 
Ag)X + Agoy + Agq 


Let us require that the condition y? = x be satisfied. For this, it is 
sufficient that the equations obtained take the form 


Gog ~ Ag3 (a3 — 33) 
= 14+—**—_,, x= So .. 
2 AX + Asay + agg at Q31X + Aggy + Ag3 
Now, 
Qo, = G33, Ang = Gzn, yy = Ag, = 3 = gg, 
Gy9— Azo = Agg — Ag. 


Matrix (5.68) takes the form 
Gy gg + Ay3—A33 yg 


ay agg ay] . (5.70) 


It leads to the equation 


24,99 + (Gog — 243) y" + (gq — Gag) — yg = 0. (3.71) 
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Let us put, in particular, a, = a. = 1 and let us write a—1 = p, 
3 = —q. The matrix (5.70) takes the form 


1 -p-q -@ 
1 1 -q|. (5.72) 
1 1 p+i 
It leads to the equation 
yYt+pytg=0. 


When p = 0, g= —1, the matrix (5.72) becomes the matrix for extract- 
ing the cube root. 

EXAMPLE 23. Let us apply matrix (5.72) for obtaining approximately 
one of the roots of the equation x*-x—1 = 0. We have 


12 1) 1 4 12 37 114-351-1081 
1 121) 1 3 9 28 86 265 816 
1 1 0} 1 2 7 21 65 200 616 

1 25 1-285 1:333 1-292 1-325 1-324 


Notice that the convergence of this method is only rapid when 
the equation does not possess two roots close to one another in abso- 
lute value. 


7. Recurrent series. The Bernoulli—Euler method 


A power series x a,x", the coefficients of which, as froma certain 
n= 
n, are connected by the same linear relationship, is described as recur- 


rent. The following theorem holds: the necessary and sufficient condition 


for the sum of the series ¥° a,x", convergent for |x| < 1, to be a rational 
n=O 
function of x is that the series be recurrent. 

D. Bernoulli and Euler applied recurrent series to the solution of 
algebraic equations. Cauchy provided the basis of the method by 
indicating that, if x, is the root of least absolute value of the polynom- 
ial Q(x), the radius of convergence of the series 
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where P(x) is a polynomial having no roots in common with Q(x), 
and the degree of which does not exceed the degree of Q(x), is given 
in accordance with d’Alembert’s test by the relationship 


s a, x: 


n=—»co an 


from which it follows that 


ay 


x, = lim 
neo In+1 


For instance, Euler solved the equation x*—3x+1 = 0 by using 
the following expansion: 


1 


PRR ica SEEROEE 2 15 4 5 
(=a 1+ 3x + 9x? + 26x3 + 75x4 +-216x5 + 


+6229 +1791 x? +5157 x8 + 1484922 + 
4427560 +... = Tay". 


nad 
Here x, = lim a,/a,,,, where x, is the root of least absolute value 


u— 
of the equation x3—-3x+1 = 0. The convergence of the process is 
clear from the following table: 


a, 


rot 


0-333 
0-333 
0°346 
0-3467 
0-34722 
0-34727 
0-347292 


ANM WH 


On replacing x by 1/x, the same method can be used to find approxi- 
mately the root of greatest absolute value of the equation Q(x ) = 0. 
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The convergence of the Bernoulli-Euler method is also only rapid 
when the equation does not have two roots close to one another in 
absolute value. 


8. Connection between the Bernoulli—Euler method and matrix methods 


Let us find by the Bernoulli-Euler method the root of least absolute 
value of the equation 8+ px+g = 0. For this, it is sufficient to expand 
1/(¢+px+.x°) as a recurrent series. We have 


1 


Gipxae ~ Ag + Ayx + Agx? + G<bpe-te: 


On equating coefficients of powers of x, we get 


1 
Ay = 7 gA,+p4o=0, gdp+pA,=0. gAs+pA3+ Ay = 0. 


and in the general case: 
gAy+PAn-1+An-3s = 0 (= 3). 
This relationship can be written as the matrix equation: 


0 @ 90) (An-s GAn—2 
00 G| |An-2) = | G4n-1 
-1 0 —?p An-1 gAn 
But this equation gives only one new coefficient A,, while the two 


preceding ones are repeated. Ontaking the cube of the matrix com- 
posed of the coefficients, we at once obtain three new coefficients: 


0g 0) An-3 PA, 
00 q An-2| = PAnat , 
-1 0 -p Ans PAn+2 
i.e. 
g 0 p¥ Ans GAn 
—pq gg | | An-2| =| P Ano 
Pe —pq pe+q?} \An-1 9An+2 
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On applying this method to the equation x*—3x—1 = 0, we get 


-1 0 3) 1 26 622 = 14849 
—3 -1 9) 3 75 1791 42756. 
—9 ~3 26) 9 216 5157 123111 


An even higher power of the initial matrix can be taken; this still 
further strengthens the convergence, though not all the coefficients of 
the recurrent series are utilized in this case. The elements of the matri- 
ces obtained can be divided by the same number, since we only need 
the ratios of neighbouring coefficients. But the series obtained here 
will in general differ from the recurrent series, into which 1/(¢+px+ *) 
is expanded. 

On replacing x by 1/x, the same method can be used to evaluate the 
root of greatest absolute value of the equation x*+px+q= 0 (if 
the corresponding process is convergent). 


9. Solution of higher degree equations by means of matrices 


We can use a method similar to the above to form nth-order 
matrices that can be employed for the approximate evaluation of 
the roots of an mth-degree equation. For example, the matrix 


k la, 0 0 0 0 0 0 
0 kK lay 0 0 0 0 0 
0 Oo 0 la, 0 0 0 0 
0 0 0 k lan 0 0 0 
0 0 o.. 0 k la, 0 0 
0 0 oOo... 0 0 k 0 lan 
—lay —la, —la,... —lay_s —lan_, —lan_g k—lay_, —laq_, 
0 0 0... O 0 0 lan, k 


can serve, when the corresponding process is convergent, for approxi- 
mate evaluation of one of the roots of the equation 


Ag X”™ + Ay iyX™ 1 t ... +aQQX+a = 
For example, in the case of the equation 
xt— 8x3 +x2?-x+1 = 0, 
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we obtain on putting k =] = 1: 


0 0, 1@12 4 UW 58 455 
0 411 1@)1 2 7 47 397 3500 
9-1} 1(8)4 35 310 2753 24463 217403 
1 1 1@)1 5 40 350 3103 27566 

1 4 7 7:75 7-866 7:8837 7-886 


The exact value of this root is 78873... . 


10. The idea behind Jacobi’s algorithm 


Euler posed and partially solved the problem of finding the solution 
in integers of the equation a,x, +a_x_,+a,x, = 0. Jacobi posed the 
analogous problem for the equation 

OyXy+HQXe +... HOyX, = O 
and developed for this purpose a special algorithm, which is a gener- 
alization of the algorithm of continued fractions. In particular, Jacobi 
assigned to this algorithm the following form: 


Unger = Va—Palln, 
Yaar = Wa Inns | 
Wna+1 = Un. 

Here, p, and g,, are positive integers, chosen in such a way that 


Ung, and y,,, are the least possible positive numbers. With the aid 
of the numbers p,, and g,, we form the following relationships: 


An = GnAn-1+PnAn-2+An-as 


(5.73) 


Ba = InBu-1+ PnBa-2 + Bn-a, 
Ch = @nCn—1 +PnCn_-2t C, —3? 
Bi, By By 


100 
=10 1 O01. 
C.. CC, ¢) |o01 


In this case, when Jacobi’s algorithm is convergent, 


(5.74) 


We suppose that 
[ A_y Ag 


oe | u : 
lim = ; lim = —. 
Hee Ch Wy nveoCy Wy 
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Jacobi’s algorithm enables us to find fairly small integers 4,, B,, 
C,, approximately proportional to the given large numbers 4, ¥,, Wy. 
EXAMPLE 24. Let us solve approximately the equation 


xityi:z x 49:59:75. 


We have, on using Jacobi’s algorithm, 


1 Un Yn Wa Pn Gn An Bn Cn 
-2 1 0 0 
—1 0 1 0 

0 0 0 1 
149 59 75 1 ft 1 1 #41 

2 10 2649 2 4 4 5 6 

3 6 9 10 1 1 5 6 8 

4 3 4 1 2 15 18 23 

5 1 0 3 0 3 49 59 75 

6 0 0 


Thus, for example, 5: 6: 8 = 15: 18: 23 = 49: 59: 75. 

The order of filling up this table is as follows: we first evaluate 
u, =49, v,=59, w,=75 and A,, B,, C,, with n= —2, —1, 0. Next, in 
accordance with algorithm (5.73), we evaluate py, 9, Ua, Va, Wa. Then, 
with the aid of relations (5.74), we evaluate 4,, B,, C,. Next, in accord- 
ance with algorithm (5.73), we evaluate py, gz, Us, V3, W3- With the aid 
of relationship (5.74), we evaluate A,, By, Cy, and so on. 


CHAPTER VI 


SOME SPECIAL CONSTANTS 
AND FUNCTIONS 


THE present chapter contains information on real constants and 
some real functions commonly encountered in analysis.t 

Our treatment must take into account the fact that differing defi- 
nitions are current in mathematical literature. For instance, the 
generating function of a sequence of functions is usually defined as 
the function of two variables f(x, y) for which the relationship 


fe) = ¥ ont", 


is satisfied in some domain of the x, y plane, ie. the y,(x) are the 
coefficients of the expansion of f(x, y) as a series in powers of y (cf. 
the definitions of the generating functions of Bessel functions and 
Legendre polynomials), In other cases, f(x, y) is called the generating 
function of a sequence if 
fea 9) =F Po ym 
n=l : 

(cf. the definitions of the generating functions of Bernoulli and Euler 
polynomials). 

There is also a lack of uniformity as regards the notation for 
various functions. In such cases the different notations will be quoted, 
though only one of them will be utilized. 


Tf Information concerning functions of a complex variable will be given in a 
later volume. 


304 


SOME SPECIAL CONSTANTS AND FUNCTIONS 305 


§ 1. Various constants and expressions 


1. Some well-known constants 


1°. The number 2: 7 = 3°14159 26535 89793... 

The number z made its appearance in connection with the calcula- 
tion of the length of a circumference by finding successively the 
perimeters of the inscribed and circumscribed regular polygons with 
2” sides. z is a transcendental number. 

Some approximations for the value of z: 

7 = 22/7 (Archimedes? number); 

zm = 355/113 (Metsiev’s number). 

Some representations of x as series and products. On putting x=1 in 
the power series expansion of arc tan x, we get the Leibniz series 


Lipa en Lenn coir a (| eee 


4 ZtETF +t.... (6.2) 


With x = 1/V 3, we get from the same expansion 


fd 1 ii o1t 1 i 
a alisats 3-7 et nh ‘\. (6.2) 
Since z = 16 arctan (1/5) —4 arctan (1/239) (Machin’s formula), 
we have 
x= 16( 1 1 Lod ieee . 
SG. SSR SS 75 8 a9, he 
1 11 
ei —4(a5-3 at): (6.3) 


Wallis’s formula is 


Was (2n)!) 72 1 
were | aman | Ine" ~ 
As a continued fraction: 
Er 1 2 2? n 


4” T+3+54+...¢2n41+., 


(6.5) 
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Other relationships are: 


+ = yee tan = : (6.7) 
. = > arc tan 7 (6.8) 
Ear (6.9) 
O=<G< = 
ae ee eee at 

Be ee SS | 8) 

2 ei 
= Fess ae (6.13) 
= = fer es +o tet vas AGT) 
z Z iy (6.15) 

2 © 

7 2 on iF oo) 
= 2 Eco ye. (6.17) 
Fars E cae. (6.18) 


SOME SPECIAL CONSTANTS AND FUNCTIONS 307 


3x2 = 1 

== 1-2 YG (6.19) 
ze 1 1 1 1 
76 = at eet er taet---- (6.20) 


3x? 1 1 1 


1 
356 ot pe tort set: (620) 


Inequalities connected with the number x. If a,=0 (n=1, 2, ...), 
but not all are zero, we have 


e an) aa 5 oh 5 a (6.22) 
n=l n=l n=l 


ze being the best constant in the sense that there exists a sequence a, 
for which equality is attained. If f(x) = 0, f(x) #0, fEL*(0, =), 
xf €L, (0, ~), we have 


4 
{ “fax! = 25) { ” £%(x) “| | "oreo (6.23) 
0 0 


9 


where 7? is the best constant in the sense that there exist f(x) for 
which equality is attained. 


Integral forms of z: 


m ° tan x 
z= I - dx. (6.24) 
bd ° sin x cos mx 
z =, a ale dx,m <1. (6.25) 
ae ee (6.2 
a= , x. (6.26) 


+ JE = if sin (x?) dx = ie cos (x*) dx, (6.27) 
0 0 
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$-[ a= = cos x 
ram aaa Pet 
a vax 
2 ry 


Bo. In (1+) dx 


x 


2°, The number e: 


é = 2-7182818284 59045... 


Euler’s number e is defined as the limit 


1\" a 
e= lim (+4) = lim (l+a)%: 
n a->0 


N—-> oo 


e is a transcendental number. 


(6.28) 


(6.29) 


(6.30) 


(6.31) 


(6.32) 


(6.33) 


(6.34) 


(6.35) 


(6.36) 
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Expressions for e, e*, e~1, (1+e)* as series and products: 


Pmor = Lt mpyt+ 


A=, Po=2, pp=5, py= 15, pp=52,.... 


1 i 


_ 2(4\* (68 \*/ 10.12.1416 \8 
CSTs 3.7 9.11.13.15 


2 1 3 2r(n+ 1) 


3 n=0 n! 
2+2" 
(1+e? =o “T 


+m OTC) 


geet ie Va(a+d\(a+2d)...fa+(n—1)a] 


nos +"5* (a+ kd) 
1 h=o 
14 1 
+64+104+...4 2QnFl)+... 


ee 
~ J[=3 
(continued fraction). 

Some inequalities. When 0 = t Sn: 
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(6.37) 


(6.38) 


(6.39) 


(6.40) 


(6.41) 


(6.42) 


(6.43) 


(6.44) 


(6.45) 


(6.46) 


(6.47) 


(6.48) 
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When u, > 0: 
2 
0= toe (1-4) a (6.49) 
sy Nuits Uy 
ct le aE (6.50) 
Ln 
n=l 
lim sup 4 Maa =e. (6.51) 
n=» 60 Un 
Minima: 
min x* = e71, (6.52) 
O0Sx< oo 
min =e. (6.53) 


o<ax<oo Inx 


The number e¢ is the base of logarithms with which the inequality 


is satisfied: 
log ax = x—1 (Ostrogradskii). (6.54) 


The functions e* and e~* are defined as the limits 


xh x\n 
e = lim (+3) > e7* = lim (i) ‘ (6.55) 
n> n n> co n 
3°, The Euler—~Mascheroni constant C: 
C = 0:5772156649 015325... 


The Euler—-Mascheroni constant C is defined as the limit 
% ane | 
C= lim (z _- in, (6.56) 
m>eo\nei 2 


the existence of which follows from the convergence of the series with 


general term 
n+1 


e(n) = i. | tl dt. 
n 


It is unknown whether C is rational or irrational. 
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Integral forms. Since 


1 i-m, r, f, oy 1 
3 te mre=["[! (: ) P dy 


is- inm= [E-( ol yuldy— (a) 


from which we find, on passing to the limit, that 


c= fa —e-v)yl ay [eur dy (6.57) 
0 


1 


C= ii (1-e+-e77) igs (6.58) 
0 


It follows from (6.58) that 


or 


j= | “le -2 = ert at, (6.59) 
0 
Other integral forms. 
C= — [ve-tinedt. (6.60) 
0 

C= : + i dt. 6.61 
aa Merraaceral a men 

° 1 \dt 
@z =f) (cxs t Tar) F (6.62) 

ce / sin t 1 dt 
C= 1-| (F- ar) (6.63) 


o= ("ae -e\F . (6.64) 
0 
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Cc — I Gas _ -) a . 
és +t t 
= 1 
Cc = Ghoay pili dt. 
o \e-i t 


1 1 
C= =| In In — dr. 
o t 


C= i (F are cot emt) ix In p. 
okt t 


C= if e arceott~ cos pr) at —In p. 
0 we 


C= —3 [sin cin . 
ca t 


The asymptotic expansion is 


C a ia fc aw 
eo 2m 12m? = 120m*  *" 
By, 1 Bongo 1 
oh 2n mn +8 2n +2 mmmr+2? 


Infinite products expressible in terms of e and C are: 


2 ‘x (+g+h+...45-1n m)+in m 
I i = lim a i 
Py4.— ™-" nar 
n 1 
elim —— 
moe T(144 
1 


: t ia @ 
C= lim a—-?f) qortyoete ty 


t+ 1-0 


4°, Catalan’s constant G': 


G = 0-91596 55941 772190.... 


O-<6<1 


in 


(6.65) 


(6.66) 


(6.67) 


(6.68) 


(6.69) 


(6.70) 


(6.71) 


(6.72) 
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Catalan’s constant G is defined as the number 
‘1 
gs i} pda (6.74) 
0 x 


An expression for Catalan’s constant as a series can be obtained 
by expanding x7} arc tan x in (6.74) as a power series: 


ss —Im 
= =: 6.75 
@=X,Om+ iF es 
Other integral forms are: 
1 (7/2 tat 
Gas i} =: (6.76) 
n m/4 
Ga Finz42 | ttan ¢ dt. (6.77) 
0 
% wie) 
G= ~Finasa/ t cot t dt. (6.78) 
Oo 
cd mf t dt 
+G@= ~qin 2+ : Costpsn sini’ (6.79) 
a bie tdt 
es get (Sin t+cos f) sint* (6.80) 
m Soe ty 
Gea -Z ln 2-2 In sin t dt. (6.81) 
0 
Te /4 
G= =F In 242] In cos ¢ df. (6.82) 
0 
. ] (lz 1 
4+G= z| tn (L4cos 2) dt+ a In 2. (6.83) 
0 
't{% 7 
G= | In (1+ tan ¢) dt—7 in 2. (6.84) 
0 
1 Int 
G= -[ Tre dt. (6.85) 
Jt 
GS-2 in2sh (6.86) 


0 Vi-2 
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G= ig In (1+t)——> fan = In2, (6.87) 
a 1p (6.88) 
Ed In (1 -t) 
G=—sin2-| — dt. (6.89) 
8 I. 1+2? 
ltt dt 

@= | ee (6.90) 

37 1 i+2? dt 
G= atin 243. “TEP ee (6.92) 

ry 
G= [- a ee eet m2, (6.93) 
arc tan f Ed 
G= \ oman dt+Z in 2. (6.94) 
G=- | 7 ee ae (6.95) 
0 
G= girs’ (Z-arctan)S. (6.96) 
QO 
1 
Ge 2 (G-areuns) eae (6.97) 
0 

aw 1 fe at 
G= era] (are tan vale (6.98) 

_w2 ie 2 tat 
G= call (arc cot fr) Jie (6.99) 


Expressions in terms of complete elliptic integrals (see (6.380) and 
(6.381)): 


mee i} ” K(k) dk. (6.100) 
2 0 


G= | “£0 dk 1. (6.101) 
0 
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2. Soumne merical expressions 
1°. Factorials. When n is a positive integer: 


nmb=12.3...0 (6.102) 
By definition, 
Ol=1. 


The gamma function is a generalization of the factorial (see § 4, 
sec. 5). 
When m is a positive integer: 


(2m)! = 2.4.6...2m. (6.103) 
(Qm+1)!! = 1.3.5...(Qm+1). (6.104) 
(2m)! = 2"m\(2m—1)!! (6.105) 


The number n!! is called the double factorial of n. Expressions for 
factorials, inverse factorials and their sums: 


23, I 
ml 2 mim+1)... (m+n) ° ee 
nr 
(n+1)! = +d kk! (6.107) 
oe 
°° 1 e+e-1 
2 Gapt =p = cosh = 154308... 6.108) 
se 1 e—e} . 
Dy Gaciyi = gy = sia 1 = 1175201... (6.109) 
§ (oF cos 1 = 054030 (6.110) 
2 aor" = a 
22 1 
— “1 = gj = 0 
2,(-D Gqopr = sal = 084147... 11D 
F ay = h(2) = 227958530... . (6.112) 
neat (a!) 


= 1 


pa aln+)! —_ LQ) = 1-590636855 . . oe (6.113) 
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= I 
oy aiepipr = Fx). (6.114) 
> or i" = Jo(2)= 022389078... (6.115) 
2 aG@EDT a = J(2) = 0-57672481.... (6.116) 
oo (- 1)" 
xn niger 7 72) (6.117) 


Inequalities and asymptotic formulae: 


[eeva(2y <nl<eJ/n (zy (6.118) 


piss! ae (6.119) 


(2n)! 

Gyr ~ (6.120) 
ix Vat YC toot ‘ (Stirling). (6.121) 
(2n—1)!! = JE Onyre im, 10,1 <1. (6.122) 


nh 


ane 0 
ni= Jin Te e24nt12 (Gauss). (6.123) 


A formula for the logarithm as a factorial: 


In n! =,00([4]+ []+[#]+--): (6.124) 


where the summation is over all primes p not exceeding n. ( [x] is the 
integral part of x. See § 3, sec. 1, 3°.) 

Divisors of a factorial. The greatest index with which a prime p ap- 
pears as a factor in 7m! is 


Bera ee | (6.125) 


where p® = n, but p**1>n. 
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For example, the highest power of the number 2 by which 50! is 
divisible is 
50 50 50 50 50 
HLH -° 


Thus 50! is divisible by 247. 
2°. The Kronecker delta 67" (or 4,,,,) is defined by 


lnz=m_ 
a ee (6.126) 
i. if nm. 
The integral form is: 
n 
on = | Pal )Pa(x) dx (6.127 
a 


where {p,(x)} is a system of functions orthonormal in [a, 6). 
For instance, 


m= al cos nx cos mx dx. (6.128) 


n 
3°, The binomial coefcients ( or Cy", where n is any real 
m 


number and mm is a positive integer, are defined by 


(7) = n(n—1)...(n—m+1) 


m m! 


(6.129) 
When n is a positive integer: 


n n! 
/) = Sar car (6.130) 


The beta function is a generalization of the binomial coefficient 
(see § 4, sec. 5, 2°). 
Some relationships between binomial coefficients (m, m integers): 


(7) =0 for n>0, m>n. (6.131) 


m 
n n 
@ = Gear (6.132) 
n n n+1 
(oa) Gone) = (ies) (6-123) 
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(3) ea(E) (Ee 


(‘ )- (i +2 Jn ae my Jac m(",'): (6.135) 
ce oar! ‘eo (or) =o (6.136) 


n n ae 
(s)+(3)+C )eeve2 1, (6.137) 

n n n n— 
(+3 )+(G)t =? 1, (6.138) 
(o)+(3 tee t(gcr ee (nis odd). (6.139) 


0 
(7) ue teeta )= 227-2 (n is even). (6.140) 


= (3—1)"+1 5 sin =. (6.141) 
(o)+(3)+(G)+ = a(e +2605): (6.142) 
()(e)e-n Hone tm 
()(2)(ije-c3(eee) am 
(S)+(2)+(3 Ja ioe =), (6.145) 
(1)+(3)+(Z)+--= 5 (24428 sin =). (6.146) 
(2)+(2)+( 4) +: = (22-27 cos). (6.147) 
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(s)+(4)+( fee = f(a 2F sin). (6.148) 
(2)-(5)+(4)-(o) + = 2 os (6.149) 
(")-(5)+(4)-(4)+ + =F sin (6.150) 

(s)+2(7)43(3)+ +0+0(" ara (6.151) 
(7)-2 (F)+3 (5)- 7 +(-yem(7) =0(n1). (6.152) 
ADAG) BE ()-atr wo 
(s)ed(t)ed(s)etatn(Q)- 2B cs 
a(S) eF (2) F(2)e ZED) RGE. un 
(-AG)HG)- FC) 
= 1+ th (6.156) 
CP [eC-C)) 
= 12424... 47% (6.157) 
()(2() (eB) ()(8)-C2) 0 
(o)(E)+(1) (ats )+-- +(e) () * 
= (ns = oe (6.159) 
(t)+(t) +--+ mC eae (6.160) 
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(B)-(rJe+(B)-cr)- 


2n+1\?_ /2n+1\? 2n+1\2 

( i ) ( Jr) =0i 
n\? n\? n\? 
(1) +2(g) + +9(2) . 


= (-1 


= 2n—2\ _ (2n—1)! 
= (2n v7 ale (nip 
Binomial and polynomial formulae: 
a. ‘a fs — arigh:, 
oe) vrtigen %!%! aia 
(q+ a=... +4)" = 
nl 
= Se ee a1, ene a . 
eink aes vIn,! one vy! m'43" ay 


Some identities in connection with binomial coefficients: 


3 a(n) ad =X 


k=O 
2 kn seer ae 1\ ,,1 
Se (eyeen =(1-3)F +7 x. 


n fk 2/n nok — XU-x) 
B(2-*) (i )"a-» ices ea 


(6.161) 


(6.162) 


(6.163) 


(6.164) 


(6.165) 


(6.166) 
(6.167) 


(6.168) 


The Bernshtein polynomials B,(f) of a function f(x) are defined by 


the relationship 
B= Z,(f)d-a (5). 


(6.169) 


If f(x) is continuous in the interval 0 = x < 1, the sequence{B,(/)} 


is uniformly convergent to f(x) in this interval: 
lim B,(f) = f). 
n—> co 


(6.170) 
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Asymptotic formulae. 
2n 220 On 
(+) ~ Feet 10) < 1 (6.171) 
1 
nts 
Vege MES ee tee ELD 
m In mth n=+h 
m %(n—m) 2 


k 
nfn\k 2knf 2\ 2 
—). =[{— : 6.173 
3G) ~ Zs) ee 
nhtlt 


nk+1\  (k—-1" fk 
(2) 8a (cb) am 


es ) =TG5t Fen + OlnP-9-), ~ (6.175) 


Fibonacci numbers and the golden section. The sums 


rm n—(k+1) 
=¥ ( ) (6.176) 


are connected by the relationships 
Un, = Ujiytun-» 2> 2, w= w&= 1. (6.177) 
The numbers u, are called Fibonacci numbers. Binet's formula holds: 
2 2 
V5 


The following are consecutive values of the Fibonacci numbers: 


Un = ; (6.178) 


Uy, Uz, Ugy.. 


1, 1, 2, 3, 5, 8, 13, 21,.... 


The Fibonacci numbers appear in the expansion as a continued 

1 1 
~T+T+... 
have the form u,/u,,,(2 = 1, 2,...). 


| ats 
fraction of the number (Vv. 5-1) . The convergents 
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1 
The number e = > (V5 ~1) is occasionally called the number of 


the golden section. It is defined as the mean proportional between 
1 and its complement to 1: 


a? = 1.(1—2). 


It was supposed in classical aesthetics that, for instance, the rectang- 
le with ratio of sides «, or the ellipse with ratio of axes «, were partic- 
ularly pleasing to the eye. Hence the name golden section. 


§ 2. Bernoulli and Euler numbers and polynomials 


1. Bernoulli numbers and polynomials 


Special number sequences, e.g. Bernoulli and Euler numbers, prove 
useful for obtaining power expansions of numerous functions. 

1°. The Bernoulli numbers B, (n = 0, 1, 2, ...) are defined as the 
coefficients of the expansion as a power series of the function t(e'~—1)-} 
for |t| < 2m: = 
eek Spe (6.179) 

~t xo "xn! ; 

These numbers were first mentioned by Johann Bernoulli (Ars 
Conjectandi, 1713), inconnection with the problem of summing powers 
of the natural numbers. The numbers B figure in the power expansions 
of the functions tan ¢, tanh ¢, ¢ cot t, ¢ cotanh f, etc., in the Euler— 
Maclaurin summation formula, in the asymptotic form of Euler’s 
gamma function. 

There is no one accepted notation for the Bernoulli numbers. In 
certain works, B, is used to denote what we denote in the present sec- 
tion by | B,|, or Baz, or | Bey |- 

Recurrence relations. Using (6.179), rewritten in the form 


Pesys ie 
n=0 mente 


cross-multiplying the series on the right-hand side and comparing 
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coefficients of powers of t, we find that 


Chi pBat Chay Bnirt oes + CR Bp nat o-- 
we. $C%,,B, + By = 0 (6.180) 
or, in symbolic form: 
(14 Bye+t— Bnt1=0, (6.181) 


where, after raising to a power in accordance with the binomial for- 

mula, all the exponents of the powers are replaced by subscripts. 
Since 

He! 1I)-4=(— Nett = = = 


25 B me (6.182 
= ay bk+1 Dep! (6.182) 


all the Bernoulli numbers with odd subscripts, n = 3, are zero. All 
the Bernoulli numbers with even subscripts are non-zero, B,, being 
positive for 2 odd and negative for n even (see (6.194)). 

Laplace’s formula 


1 

3 1 0 . 0 

1 1 
zr T 1 0 

B, = (—i)"l] 4 1 1 (6.183) 

a oT ar eae 0 
wots el eae 
(#41)! nl @-D! °° 2! 


gives an explicit expression for the value of a Bernoulli number in 
terms of its subscript. 

The Bernoulli numbers are rational. This follows, for instance, 
from the previous formula. 

StauptT’s THEOREM. Every Bernoulli number B,, can be written in the 


form 
1 
B, = Ca—- Leer (6.184) 
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where C,, is an integer, and the summation is over all k > 0 such that 
k+1 is prime, k being a factor of n. 

For example, when n = 6, the factors of nm are k = 1, 2, 3, 6. On 
adding unity to each of these, we get the numbers 2, 3, 4, 7, of which 


the primes are 2, 3, 7. Consequently, B,= 1—(1/2)—(1/3)—(1/7) = 
= 1/42. 


Some Bernoulli numbers: 


1 1 1 
B=1, R= -“ 7 B= B, = 30° 
1 1 5 
B= a By = —35: Bo = <> 
691 A 3617 43867 
Pia pags ake ge BIO) er P08? 
pee ci _ 854513 
ager: 330° ~*~" 423” 
236364091 8553103 
i ae Ta 
B,. = — 23749461029, _ 8615841276005 
mee, 870 tee 14322,—” 
7709321041217 2577687858367 
Be ay a aan a 
B,. = —.26315271553053477373 
Bhi 1919190 
p,. = 2929993913841559 , __261082718196449122051 
ed 6 Beene: 13530 


Some power expansions with coefficients expressible in terms of 
Bernoulli numbers. Since + coth 5 t= {t/(e"—1} 5h it follows 


from (6.179), after replacing ¢ by 2t, that 
w= 222 RB, {20 


t cotanhr = 14+ ) ——“—_,, |t| =a. 6.185 
mena ant, 8 oe 
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it cotanh it = tcott, tant = cot t—2 cot 2t, 


t 
tcosect = tcott+ftan—, 


tanh ¢t = 2 cotanh 2t—cotanh t, 


cosecht = — cotanhf — cotanh > 
we get 
= (- 12" By 
tcott = 1 — r,t q. 6.186 
2 ai |t}<m. (6.186) 
es (22 — 1)220(— 1)n-1 7 oe 
tant or om Bypt™1, |t|< z (6.187) 
es, (2— 22")\(— 1)" 
tcosect = i+ aa Boyt, |t| <2. (6.188) 
= 5 MORAY Bent Ld 
tanh ¢ a» (ni Bopt?®-1, [t| < 7: (6.189) 
tcosech ¢ = 1+ uaa By,t?"-1, |t] <2. (6.190) 
ney, (2m)! 7? 


sin t S (-)2?*Ban on 
We open 


jt] <a. (6.191) 


(= 1972242" 1) Ban on x 
est = 2 aa en, |tl< 7 (6.192) 
tant SS (— 1)*+1280(22n-1 — 1) 8. 
In —— = foe See mm, | t| <5: (6.193) 


Expressions for the sums of some numerical series in terms of 
Bernoulli numbers. If we compare expansion (6.186) with 


2 ee cara | 
foot = 1425) yas am) =1-2F 5 me 


it follows that 
(—1)9~12(2n)! = 1 


Pan = a ay 


(6.194) 
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The equations follow from (6.194): 
= 1 (— 17327)" 
by = 


ey mie = Fat Ba (6.195) 
56 om ae = SE ae 6.199 
> moDF = a an: (6.197) 
In particular, é 
ie = By z., (6.198) 
PIG i = ae = z.. (6.199) 
Las a 2B al =. (6.200) 
in = ar (6.201) 
is = (6.202) 
in = oo: (6.203) 


Some integrals expressible in terms of Bernoulli numbers. Integral 
JSorms of Bernoulli numbers. The relationship 


= i t72n— 1, 
-aem|, en mizan—idt 
leads in conjunction with (6.194) to the following relationships: 
eo 2N—1 
Boy = (~ IP san | say (6.204) 
t2ndt 
= (~ yea |” rae (6.205) 


Bon = (-— ee t2n-2 In (1 — e~2**) di. (6.206) 
0 
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oe Vales, | ; tat (6.207) 
be (-Y aoe i. Cnr ae. (6.208) 
Bon = (— 1)" er ie (6.209) 
a ee } 7 (6.210) 
Be (-y [ie (In 1)e"-1 ze ; (6.211) 
Ban = (~1)"72 me (in 12" ace: (6.212) 
ae (=P oe ee (in tan 1)2-1 — (6.213) 


Bungg = (— Iyer 2@E Dnt D i “angina, 6214) 
0 


2°. The Bernoulli polynomials are given by the formula 
n 
B(x) = («+ BP = ¥ (z) Byxn-, (6.215) 
R=0 


A number of authors consider, in addition to the polynomials B,(x), 
the polynomials 


Pn(x) = Ba(x) — Bad (6.216) 
It follows from (6.215) that 
B,(0) = Br Pn(0) = 0. (6.217) 


The generating function for the Bernoulli polynomials is te*(e! ~ 
—1)7) Its expansion as a power series, convergent for |¢| < 2z, 
has the form 


oo Te 
rect 1)-1 = FB). (6.218) 
my ni 
The difference equation 


fet D—fG) = nxt-3 (6.219) 
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is satisfied by the Bernoulli polynomial. This follows from (6.218) 
and the relationship 


te(@+It(et — 1)-1 ~ tet(et— 1)-1 = te, 
Recurrence formulae. Differentiation of (6.215) gives 
BAX) = nBy_(x) (6.220) 
from which it follows that 


B,(x) = B,(0)-n [a0 dx. (6.221) 


tt) 


Some Bernoulli polynomials: 


B(x) = 1. (6.222) 
Bx) = x5. (6.223) 
Bx) = P—x4 + (6.224) 
3 1 
B(x) = Wm FMS x (6.225) 
B(x) = 2a, (6.226) 
Bee Sa eae mee 
B;(x) = x8 Zw+Z x 5 (6.227) 
Hej = sees oe pe (6.228) 
. 2 2 42° . 
7 7 7 1 
apt yh pe ye 
Bix) = x 5 eae adie teller te (6.229) 


14 7 2 1 


= x8—4,? Boot yt 2 yh 
B(x) = x8 ~ 4x74 Zama xtt sx. (6.230) 
9 21 3 
= x9 — = x8 ; ee ead 
B(x) = x ia + 6x z 54233 70 * (6.231) 


Byo(x) = xt0— 5x9 + &. x8 — 7x84 5x4 — 3 x4 & ‘i (6.232) 
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Zeros of Bernoulli polynomials. The following formula holds: 
B,(1—x) = (— 1)"B,(), (6.233) 

from which, letting x = 0, we get 
B,G) = (—1)"B, (6.234) 


and, since B,,,, = 0, we have 


BQ) — By, = B,(1)— By) = 0 (6.235) 
for all 2. 
It follows from (6.216) and (6.235) that 
Pn(0) = 9,(1) = 0. (6.236) 


It follows from (6.233) with n=2k+1 and x = 5 that 


1 1 
Borst (z) = — Borst (3) (6.237) 


1 
Panes (=) Lg, (6.238) 


or 


The polynomials 9,(x) with even subscripts vanish on the segment 
[0, 1] if and only if x= 0 or x = 1; the y,(x) with odd subscripts 
vanish if and only if x = 0, x = > orx=1, 

The polynomials ¢,,(x) with even subscripts are of constant sign, 
the same as that of (—1)*, on the interval (0, 1); the polynomial 


Pon41(*) has the sign of (—1)*~! on the interval (0 3) and the 
sign of (—1)* on the interval (> 1). 


A multiplication theorem for Bernoulli polynomials: 


m—-1 s 
B,(mux)=m"-1 > B, (= + =) . 


s=0 
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This relationship follows from the fact that 


= Bmx)" emtr 1 emt +e'+ ... felmnD) 


nao on! e—1 m emt —]} 
ed hyn 
pomer me mea n(x ee 6.24 
on ee OM em ht ay n! + (6.240) 


Trigonometric expansions of Bernoulli polynomials in the interval] 
(0, 1): 


1 e sin 2nmx 
BO) tog = 2 (6.241) 
1 & cos2umx 
Bx) = = Y Fa (6.242) 
(=I? = 1 = cos 27mx 
Tiny Bant®) = aeamigaw 2 —ggan —* === «(6.243) 
{=> 1 eo sin 2umx 
(n+ iy! Bona s(X) = Ser ey ma (6.244) 


Integral forms of the Bernoulli polynomials in the interval (0, 1): 
°° cos 2x — e— 3 

9 cosh 2xt—cos 2nx 
(n= 1, 2,...). 


- in 27x 
Bon @) = (mens | SE edt (6.246) 
ais > cosh 


Boy (x) = (—1)"*12n 127-1 dt (6,245) 


2nt—cos 27x 
a= 0, 1, 2,...) 


Application to the summation of powers of the natural numbers. On 
assigning to x in (6.219) the values 0, 1, 2,..., p and summing, we get 


& gona = P+ DB 
en n 
or, on replacing n—1 by , 


= Basi(ptl)— Baas 


; 7 (6.247) 
& 
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For example, 


$e AEHDEB A (a4d 048) 


Sat 3 3 
= Pent Dep +)) (6.248) 
ys & Ae aL ake — 29 + pt) = alae (6.249) 
Bo BPtD— Bs _ 1p 34592) — 
aaa ae) a ). 
=f r(p+ 2+ NGe+3P+1). (6.250) 


ans Bo(p + 1)— Be ren i 6 3,5 5 1 BP ee 
bt a SOP = Gots get- 2 | = 


o Ppt D2p?+2p+1). (6.251) 


The Euler—Maclaurin formula establishes the connection between 
the integrals and the sums: 


[Pp ae = [LO 1 "Fn0]- 
o 


—"S Be reno) —per-vqy— Em. (6.252) 


If f(x) and all its derivatives encountered in (6.252) tend to zero, 
while the derivatives of even order differ from zero and all have the 
same sign, the summation formula holds for m = ~, if the sum and 
integral appearing in it are convergent. 

Stirling’s formula is obtained from the Euler—Maclaurin formula 
if we put f(x) = in x in the latter and make the lower limit of integra- 
tion equal to unity: 


mai 
D> Ink = min m—m—— In (m+ 1)+ 
=1 


4 we BoA{m-2t1 = 1) 


J Orarat) ee (6.253) 
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When n = 2, it follows from (6.253) that the asymptotic Stirling for- 
mula for the factorial (see (6.121)) is 


1 
m! ~ Jf2um"* Fe-m, (6.254) 


2. Euler numbers and polynomials 
1°. The Eyler numbers E, (k= 0, 1, 2, ...) are defined as the coeffi- 
cients in the expansion as a power series of the function 
ie ae ore, (6.255) 
ney "kl? 2 
Since the function sech ¢ = 2/(e'+e7) is even, it follows from 
this that the Euler numbers with odd subscripts are zero: 
Egmy1 = 0 (m= 1, 2,...). (6.256) 


Recurrence relations. It follows from (6.255) that 


co f2n fe rh 


l= 2. Tar 2 Ey er (6.257) 
whence FE, = 1 and 
Eyt CE Eg + CH Egt «6. + CR Egy 2 t Ean = 0. (6.258) 
In symbolic form: 
(E+1)"+(-1)"=0, Ey = 1. (6.259) 
Some Euler numbers: 
Eo=1, &=—-1, R= 5, Ey =— 61, Ey = 1385, 


Ey = —50251, Ey, = 2702765 
Ey = —199360981, Ey, = 19391512145, 
Ey, = —2404879675441, Eq = 370371188237525. 


All the Euler numbers are integers. This follows from the recurrence 
formulae for the £,. Two adjacent numbers with even subscripts 
have opposite signs. 

SYLVESTER’S THEOREM, If a, 8, ,... are factors of the number 
n—m, the difference E,,~Eym, is divisible by those of the numbers 
2a+1,2B+1, 2y+1, ... that are prime. 


SOME SPECIAL CONSTANTS AND FUNCTIONS 333 


The connection with Bernoulli numbers. Starting from the identity 


4x 2x 2xe-* 


we obtain. 
oo xn oo xt °° (~ 1)mcmt1 
y By2™(2"— 1) = X Lay Dy oOo 
n=0 i=o 


> 
Leo m! 


from which it follows that 
- n(E- 18-2 


Br = ~ 3737 Ty) . (6.260) 
Starting from the identity 
4x 4x 
wu 8) aes 
we get 
oo (4x)™ = Gx)! x! oo xk 
wey om m! » It TP = 2x 2 Fa Gr 
which gives 
A Re 
Eniy = GB+3h—-GB+ IF (6.261) 


2k 


It follows from the last relationship that 


2k+1 3 \ak+1 | \2k+1 
acer (243) -(2+4) » (6.262) 


which gives, on taking (6.215) and (6.233) into account, 


2k+1 1 
Saws Ean = —2Baraa (z): (6.263) 


The sign of the Euler numbers. As follows from the discussion on 
page 329, By,4,(x) has the sign of (—1)*~? in the interval (0, 1/2), 
so that £,, has the sign of (—1)*. 

Some power expansions with coefficients expressible in terms of 
Euler numbers. Observing that sec t = sech it, we get 


a E. ord 
= — [je 22k por pal 
sec t 2 At 1) (KI rk, [t| < > (6.264) 
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On integrating the last series, we get 


we (344) 


Integration of series (6.255) gives 


‘ Ec Dy arent pm, [t1< 5. (6.265) 


kD! 


2 hed 
arctan et = 4 ¥ J : (6.266) 


a+ 2,0 Ep’ 

The expressions for the sums of certain numerical series in terms of 

Euler numbers. On putting x = 1/4 in (6.244) and taking (6.263) 
into account, we get 


I I 1 (~ DPE nek+1 
i 3enti + Sakei Jake "°° ~~ akea2E] (6.267) 
For ‘example, ; 
= Sy) 
>, = ” Sa aaa de ae! 1) GQm+1P 30° (6.268) 


Integral forms of Euler numbers. It follows from (6.246) and (6.263) 
that 


on = (— 1MDeRtI | "18 sech (xt)dt (n= 0, 1, 2,...). (6.269) 
0 


2°. The Euler polynomials are given by 


Bie IG -3+3) fe ba ( : ) 2-*E, (= s =) , (6.270) 


where £, are Euler numbers. 
The generating function for the Euler polynomials is 2e*(e'+ 1)-}. 
Its expansion as a power series, convergent for |¢] < 2, is 


a fk 
2e*(et +1)71 = LE) ee (6.271) 
The difference equation 


SHAD TS@) = 22" (6.272) 


is satisfied by the Euler polynomial E,(x). This follows from the 


relationship 
Dele+ tet 4 1)-1 4 2extet4 1)-1 = ext, 
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Recurrence formulae. On differentiating (6.270), we get 
E,(x) = nEq (x) 
from which it follows that 


] x 
€,(x) = E, (2) +n { Ey -1(x) ax. 
1/2 
Since £,(1/2) = 27™E, (see (6.270)), we have 


E,(x) = 2-"E, +n ii E,_ (x) dx. 
1/2 


In view of the relationship 


335 


(6.273) 


(6.274) 


(6.275) 


20 tf of pm oo fn 
deere t= PEO Y = Y Eee) 
r=0 Yr. mao Mm! n=0 nt 


we have the recurrence formula 
= n 
E,(x+1) = > (+) E,(x), 
rmQ 
or, on taking (6.272) into account, 
ain 
- Eq(2) = 2x" 3( ) Be). 
reo\ lr 


Some Euler polynomials: 


E,(x) = 1. 
E(x) = x5. 
E(x) = x*~—x. 


eGp ol 
E,{(x) = Bm >x +z: 


E,(x) = x*-—2x3 4x. 
De ee ee ae 
Ex) = P->xt+ ss. 


E,(x) = x8— 3x5 +523 - 3x. 
7 35 21 17 
Sg NY PT ca OP” eters mee 
E(x) = x e+e Tt. 
E,(x) = x8 — 4x? + 14x5 — 2823 — 17x. 


(6.276) 


(6.277) 


(6.278) 
(6.279) 
(6.280) 
(6.281) 
(6.282) 
(6.283) 
(6.284) 
(6.285) 


(6.286) 
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The connection between Euler and Bernoulli polynomials, Starting 
from the relationship 


ot t -1 t xt 
say aes ete = 
te® (4 ey, = te 2 (et 1)-1- te 2(e@—1)-3, 


we get 


pio emnfn(32)-0 (5) 


= 7-12 {ac 2B, (3) . (6.287) 


Trigonometric expansions of Euler polynomials. On using the 
trigonometric expansions of Bernoulli polynomials in the interval 
0< x< 1, we get 


Esy(o) = (— DP 42K)! 5: [n+ Dpx]-2-4 sin Qn + Dax 
(n = 1, 2, 3, ...). (6.288) 


Enpal®) =(— DEH 402k +1)! Lien + 1)n]-2*-2 cos (2n-+ Lux 
(n = 0, 1, 2, 3,...). (6.289) 


A multiplication theorem: 


mat 
E,(mx) = m™ y (- DE, (=+5): m=2k+1. (6.290) 
eS 


mri 
E,(mx) = —2m"(n-+1)-1 ¥ (~ WBree( x +). m=2k. (6.291) 
r=0 
Integral forms of Euler polynomials may be obtained in the same 
way as those of Bernoulli polynomials: 


‘ee 720 sin wx cosh xt 
—f—1\n 
Ex) = (84 I. cosh 2xt—cos 2xx a (6.297) 


(O<x<1; n=0, 1, 2,...), 
122+1 cos xx sinh at 


Enis) = (- peng | S50h Daf = cos Ge, dt . (6.293) 


QO=x<1; n=0, 1, 2,...). 
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§ 3. Elementary piecewise linear functions and delta-shaped 
functions 


1. Piecewise linear fanctions 


1°. The absolute value of x (written as |x) is: 


eee. x <0, 


0, x = 0, (6.294) 
x, x >0. 
|x+y| Ss |xl+lyl |x—yl 2 llxl—-iyil (6.295) 


The binomial expansion of |x| = ViI—(1—x, for |x| < 1, is 


1-x (2k— 3)! 


eae nia ae GE! 


(l—»)%. (6.296) 


The approximation, for |x| = 1, by Bernshtein polynomials (see 
§ 1, sec. 2) of even degree is 


Ts 1-x*?\" 2 2n l+x\F /1—x\* 
n= (VS (LC lS 
(6.297) 
The approximation by Fejer polynomials, for |x| = x, is 
eer — mz 8%) n—k cos (2k—1)x 
|x] a tim Gay = Eee m—1 (Qk—DP | 
(6.298) 


The expansion in Legendre polynomials P,(x) (see Chapter IV, 
§4, sec. 5), for |x| < 1, is 


ix] =) anPa(x), 
n=0 


1 ) 2k-3)!! 
Mp4, = 0, a = yaz Qy == (— 1)k+2 (4k) ED. 
(6.299) 
Fourier’s expansion, for |x| < 2, is 
_ %_ 4 & cos(2k+1)x 
lets a ao (2k+1? * (6.300) 
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The integral form is 


2 [@ 1—cos xt 
|x| = al a= dt, (6.301) 

Polygonal functions; the approximation of continuous functions by 
polygonal functions. Let A(x, y) (i= 0, 1, 2, ..., 2, ...) be given 
points. The function 


Six) = Yet [e~ x41 x— 2011+ 


+5 oy (kegs —k)Ux—x)+|x—x 1], (6.302) 


where k; = (1441 —Y)/@iny—*), is described as polygonal; its 
graph is the polygon 4)A, 4, ... A,. It must be borne in mind that 
qiretenail = { for x sa, 
x-a for x>a, 

If f(x) is a continuous function in [a, 5] , there corresponds to 
the subdivision a = xX» < %,< x%,< ...< x, = 5 a polygona 
function whose graph is a polygon inscribed in the graph of f(x), 
with vertices at the points (x,, y,), ¥, = /(*) @ = 0, 1, 2, ..., m). 

Every continuous function is the uniform limit of polygonal 
functions. 

On taking expansions (6.296)—(6.301) into account, we find that 
any polygonal function, defined in an arbitrary segment [a, b], is 
the limit of a polynomial sequence, uniformly convergent in [a, b] 
(Weierstrass’s theorem). 

Schauder’s basis. The polygonal function 


Fap(x) = ({x-a|-|2x-a—B|+|x—B]), « < B, (6.303) 


1 
Bra 
is equal to zero outside the interval («, 8); in («, f) its graph is an 
isosceles triangle of height 1: 

Fup(x) = 0, x=, X> B; 
a+p, 

7 

a+p 

a 


F. p(x) = 2x—-2a, x << (6.304) 


Fap(x) = —2x+2B, x > 
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Let y = f(x) be a continuous function in (@, 8). We introduce the 


numbers 


a+B 


ad =5 (3 (6.305) 


) ZU +70. 


Schauder’s basis is defined as the sequence of functions in [0, 1]: 
1, x, Fox), F 1 @), Fy 1); Fo i); 
oa 2? "4 


(), -+05 Fi iar), «-- 


oh’ “2h 


F 
ru 


GS O87, wcay Poe SO, by aed, 


+ (6.306) 


Any function f(x), continuous in the interval [0, 1], can be expanded 
(uniquely) as the series 


S@) = fO4+fD)—-fO)x+ 
+ y ose int ( F 


Keo (So ae GF e 


it (6.307) 


+1 (X). 
Py 


The partial sum of the last series 
Sax) = (0) +10) —fO)] x + 
+ SY da wa) Fi 


i 
k=O t=O 92? “QF or’ 


ia1(@) (6.308) 
2 


has a graph consisting of a step-function, inscribed in the curve 
y = f(x), with vertices at the points (i/2", f(i/2")) Gi = 0, 1, ..., 2). 
The derivatives of the functions of Schauder’s basis form a system of 
Haar functions (see (4.24) and (4.25)). 
2°. Sign x (signature x) is 


-—1 for x <0, 
sign x = 0 for x =0, (6.309) 
1 for x>0 
or 
x 
sign x = | ie ee (6.310) 
| 0 for x=0 
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or 


sign x = lim 2 arc tan nx. (6.311) 


n— co 


Fourier’s expansion is 
' _ 4 & sinQk+1)x 
sign x = aie sa |x| <2, (6.312) 
The expansion in Hermitian polynomials (see Chapter IV, § 4, 
sec. 10) is 


(2n—2)! 2n 
sign x = ae iy a =e Ana). (6.313) 
The integral form is 
aoe 
sign x = lim ze" ees dt. (6.314) 
T>0% Jy 


The sequence of signs of sine (Rademacher functions) is 
p(t) = sign (sin 2kxt), (6.315) 
r,{t) = sign (sin 2kzt). (6.316) 


3°, The integral part x (written as [x], entiére x, E(x)). If x = n+r, 
n is an integer, OS r< 1, then [x] =z. 
The following relationships hold: 


[x+y] = b1+D1; (6.317) 


[| = [3 > m is an integer; (6.318) 
pl+[sry]+--+[e+ ] = [nx]. (6.319) 


If p and g are mutually prime integers, we have 


eo] ]- 42s om 
[ea] +e} a[2]= 


= +S t+... Spt... +5y, (6.321) 


where s, is the number of factors of k, 
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Fourier’s expansion is 


yi 5-2 3 Sin 2 (x #0, £1, £2, £3,...). (6.322) 


% n=1 
The function {x} = x— [x] is called the fractional part of x. It isa 
periodic function with period equal to unity. 
4°, The distance to the nearest integer {denoted by (x)] is 


(x) = min {x— [x], 1+[]—x}. (6.323) 
The function (x) is periodic with period equal to unity. 


The Fourier expansion is 


3 cos 2x(n + 1)x (6.324) 


Gees 
OS 4 ey Ontlp 


5°. The jump function 1(x) (Heaviside’s unit function) is 


0 for x<0 
I(x) = i 6.325 
e) | 1 for x =O. ( ) 


The rectangular pulse is 


0 for x<a, x> 8, 


I(x— p= ea) = { B= a. (6.326) 


1 for «sxe, 


If f(x) is a continuous function in (a, 5], the sequence of functions 
n 
f,%) = py (xy) — x1) — 1 xp) (6.327) 


tends uniformly to f(x) on indefinite subdivision of [a, b] by the 
points x,: 
QA=X)< xX < %y<...< X= B. 


6°. The representation of certain piecewise linear functions with 
the aid of integrals and series: 


2 (sin Ea e 1 for O0O<x <a, 6.328 
A) é cos Bx a= | 4 for x 2a. ie) 


[7 exteputena = { 9 Ro e=8 


0 for x >a, 


(6.329) 


342 MATHEMATICAL ANALYSIS 


+1 for rege 


22 24 , mm Wax 2 
tom 2 1 
aed -1 for zasx<a 
2 2 F 
=F (-Dbe}1— sin — =x, OSxsa 
a n=1 
2a a nx x 
— ¥ — sin — = 1--, Osxsa 
@ 7M a a 


x for Osxaya. 


1 
a—x for qvsxs a. 


cos ee u—cos 
id 6 ) ut 
2 |” Sg os a = 
1 for |[t| = 1-6, 
={Z(-I1l) for 1-08 ihel 
0 for |[t| 21. 
co sin > 1-|t] for jt] 1 
2 cos tx dx = aia 
woo 7X 0 for |t) 21. 
1 for 03 x <a, 
zl Sin OF cos zx dz = Ee for x =a, 
mI, 2 2 
0 for x >a. 


—| ——d&= 0 for 


™Jo * 1 for 


é -1 for « <0, 

2 (sin ax 
a=0, 
a> 0. 


(6.330) 


(6.331) 


(6.332) 


(6.333) 


(6.334) 


(6.335) 


(6.336) 


(6.337) 
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for x = ath, 


0 for x < a—h, 

5 for x = a—h, 
_ 2 fT sinht 
lin =| —— cos (x—a)tdt=) 1 for a—h<x <ath, 
moo ny 

1 

2 

0 


for x > a+hA. : 
(6.338) 


2. The 6 (delta)-function 


A sequence of functions {u,(x)} is said to be weakly convergent 
in the interval (a, 5) if, given any continuous function f(x), the fol- 
lowing limit exists: 


v—> oo 


lim iy F(x)u,(x)dx. (6.339) 


If the sequence {u, (x)} satisfies the conditions: 
J. For any M > 0, we have for |a] = M, |b| = M: 


b 
| u,(x) dx 


a 


=< K(M); (6.340) 


II. Given fixed a and b, ja| > 0, [al > 0, 


lim ide 0 for a<b=<=0 or Oxa< bd, (6.341) 
vero} g 1 for a<O<b., 


then the limit (6.339) exists, does not depend on the choice of sequence 
{u,()} and is equal to f(0). The limiting element of the (weakly) 
convergent sequence {w,(x)} is referred to here as a delta function: 
6(x). Thus 


b 
| f(x)6(x) dx = (0). (6.342) 
a 
Sequences satisfying conditions I and II are described as delta- 
shaped. 
Examples of delta-shaped sequences are: 


1 


W(X) = Soeear 6 > 0; u(x) > Oa); (6.343) 
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x? 

bee E 2Sh, a Se 6508) 
2 xt 

u(x) = fan , O<v<0, u(x) d(x). (6.345) 


The elementary properties of the delta function are: 


6(—x) = (x); (6.346) 
Sx) 8(' ~— x) = FO) a(x’ — x); (6.347) 
xd(x) = 0; (6.348) 
= (x —~ x5) = (x — x5) 
= 2 eel ~FIgGol? EM) 
where x, are the simple roots of the equation »(x) = 0; 
— 5G). 
d(ax = Tal? (6.350) 
_ &x~—a)t+Ox+a) | 
608 —a?) = aig (6.351) 
|x Jb?) = d(x). (6.352) 


The convergence of the series expansions and the integrals quoted 
below is understood as weak convergence. 
The Fourier expansion, |x| = 1, is: 


11 -x) 


Ox-x) = ts Fee Se (6.353) 
n=] 


21 l 

The expansion in Bessel functions (see § 4, sec. 6), OS rs R, is: 
r’ r 
Jn(S Rim (s = 
= 2/rr’ R R 

rn = se eee ea 6.354 

CoN Toi) eu 


The expansion in Legendre polynomials, |x| = 1, is: 


te =e + 1b (x')P,(x). (6.355) 
n=0 
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The expansion in Hermite polynomials is: 


oo ext 
8(x’ -x) ¥ nea 2 A, (x)H,(x). (6.356) 
n=o 4/72"! 
Integral forms. Fourier’s integral is: 
6(x’—x) = | _ cos k(x’ — x) dk. (6.357) 


The Fourier—Bessel integral is: 


a0’) = VF { ~ Ip ( kt) I(r) ake 
0 


= (6.358) 
a(r’) = rf KeJo(ler’) dk. 
i) 
The involution is: 
[- A(t — y(t —uq)dt = 8(uy — py). (6.359) 
The derivatives of the delta function are given by: 
(x) = 10); (6.360) 
SOO @—-AD dx = -f"(h); (6.361) 
i F(X) Ald = (— EMA), (6.362) 


Series of delta functions are: 


cos x¥+Cos2x+...+cosmx+...= 
= -s48 » &(x—2an); (6.363) 
sin x+2 sin 2x+...+nsinmx+...= 
= —x 5, (e—2am); (6.364) 
cosx +4cos2x+... +7 cosmx+...= 


= — 25 8"(x—2an), (6.365) 
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§ 4. Elementary special functions 


1. Elliptic integrals 
DerFinition. Any integral of the form 


* R(x) 


—~ a dx, 
o VP) 


where R (x) is a rational function of x, and P(x) is a polynomial of 

the third or fourth degree, can be transformed to a sum of integrals, 

reducible to elementary functions, and to integrals known as elliptic 

integrals in Legendre’s normal form. The latter include the following: 
the elliptic integral of the first kind, 


in 9 dx 
Fk, 9) = ds 6.366, 
ks 9) i. IES (6.366) 
the elliptic integral of the second kind, 
sin p Tp 
Ek, 9) = | MiRee dx; (6.367) 
0 V1-x* 
the elliptic integral of the third kind, 
sin 9 dx 
Dk, 4, 9%) = (6.588 
eee | > Cte Ja- a-ha OOP 


The notations: F(p, k), E(p, k) and IH(p, A, k) are sometimes 
employed. 7 

The parameter k is called the modulus of the integral, and A the 
parameter of the integral of the third kind, k? < 1. 

The number k’ = 1—k? is called the complementary modulus. 

The quantity « is often employed, instead of k, where k = sin a. 

If we put x = sin y, the elliptic integrals reduce to the normal 
trigonometric form: 


7 dy ? dy 
Fk, = ——S——SSS SC = yz 6.369 
ko) E ee ee (6.365) 


0 


SOME SPECIAL CONSTANTS AND FUNCTIONS 347 


? 'p 
E(k, 9) = 1—R sin? p dy = i} Ay dp, (6.370) 
0 0 
ng ) eee Meee ae iy dp 
o i+Asin?y) /I—-k sity Jo +Asin® yp 


(6.371) 
where Ap = V1—k? sin? y. 
The following notation is used for a commonly encountered 
combination of these integrals: 


Ik, 4, 9) 


_ Fk, p)—E(k, 9) _ (?sin® = 
De Qe ra ig 
‘sin 9 
es _L (1 
0 Vx) G-) 
Representations as series: 
i 13 1.3.5 
Fk, 9) = dot Ak +7 Agk* +5 Fe Agk® + .... (6.373) 
aay ts 1 a a i 1.3 6 
Ei Ne Agr Ae eg EO agg ANS 
1.3.5 
ape Adi... (6374) 
where 
Ae | *sintra de (n=0,1,2,..). (6.375) 
0 


The coefficients A, can be evaluated successively in accordance 
with the formulae: 


2n-1 


Ay = @ An = an 


An-1 5 cos psint*-ty, (6.376) 
If ¢ is close to 7/2, the following formulae are convenient: 


Fk, 9) = F(k 5)- (k, 9). (6.377) 
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E(k, 9) = E(k, 9) —E(k, ) + singsing, (6.378) 


9, being given by the equation 


cos 
JI— sin? @ * 
If the upper limit of the integrals is equal to 2/2 (yp = 2/2), the 


complete elliptic integrals are obtained. 
The complete elliptic integral of the first kind is 


CIP dy 
ea [rae a TS oer 


The complete elliptic integral of the second kind is 


NI- BR? 
K A 4 fs 
E= E( 5)- ile pd = ( SS dx. (6.381) 


sin 9, = (6.379) 


Here, 
K-E 
D= aG > 3)= E° (6.382) 


Representations as series and products: 


(2n— 1)! 


K= +E [Sr] cae (6.383) 


E= 5 {14+ y | | ae} (6.384) 


ne1 
= 2n— 1 t1P 
- aa a | aa (6385) 
a 1— J/1—K_, 
== 1+k,); where k, = capes ky =k. 
3 i n) i. ee 0 


(6.386) 
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c= .90°80°70°80" 
20 a 
| G0° 
CeCe _ 
30° 
29° 
10° 
45: O° 
hae ee 
Y a 
40 ; pt 
ZGGS68 
TT rT 
12 Ct 
ue Meine cers 
Fic. 5. Elliptic _ 
integral of the first . * : 
kind Fk, 9); ee ol ae ne 
k=sina=const. 00 
? 10 20 80 40 50 60 7O 80 30° 
20 


Fie. 6. Elliptic 
integral of the se- 
cond kind E(k, 9); 
k=sin % =const. 


Qo 


0 10 20 30 40 30 60 70 8 90° 


—y 
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20 
oe 
15 40°) 
60 é 
10 0) 
haa 
0 
0s r 
10% 
a0 UF Lt 
0 10 20 30 40 50 60 70 80 90° 


——m (Y 


Fia. 7. Elliptic integral of the first kind F(k, y); p= const, k==sin «. 


as 10 20 30 40 50 60 70 80 90° 


-——— 


Fic. 8. Elliptic integral of the second kind E(k, p); gy =const., A=sin a. 
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The following formulae are employed when & is close to 1: 


= me( Jenner (18) (m-1-Z,) 


1.3.5 \2 We. Na 


12,324 2 2 VN 256 
7242.6 Gormarrar k +... ‘d (6.388) 
Here, m = In 4/k’. 
Some integrals are: 
Kadk 1 eD-K 
Edk  k*®K-2E 
(a= a sea) 
i Kk dk = E-k?K = P(K—-D); (6.391) 
2 12 
} Ek dk = iE r-2K. (6.392) 


Graphs of the elliptic integrals are shown in Fig. 5, 6, 7 and 8. 


2. Integral functions 


DEFINITION, The following definite integrals are known as integral 
functions: 
The integral exponential function 


e e 
Bi(x) = | L dt (<0). (6.393) 
The integral logarithm 
= dt 
ie Pe 0 Seen: (6.394) 


» int 
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The integral sine 
si(x) = = at («9 a 5): (6.395) 


The integral cosine 


cos ¢ 


cif) = 7. he —— dt(x < 0). (6.396) 
In addition, the following notations are used: 
Si(x) = $+s8i@) = i‘ ial i(e) = ak (6.397) 


Ci (x) = ci (x). (6.398) 
When x > 1, the function li(x) is defined as 


tim ( (70 (at 
col Jo Int a+e Int |’ 


When x > 0, the function Ei(x) takes complex values; the real 
part of Ei(x) is denoted by Ei(x). The bar above the Ei is occasionally 
omitted. 

Relationships between the integral functions are 


Fi(nx)=li(QX) (x < 1); (6.399) 
Eidnx)=li(x) (x= 0); (6.400) 
li(e) = Ei@) (x < 0); (6.401) 

Ei (ix) = ci (x) +i si (x); (6.402) 
Ei(x + 10) = Ei(X) F ai; (6.403) 
Si(—x) = —Si(x); (6.404) 
si(-—x)= —si(x) —7; (6.405) 
Ci(-) =Ci@) tai (x>0); (6.406) 


Ine } 2 
SOS ) dt. (6.407) 
x ‘ t 


SOME SPECIAL CONSTANTS AND FUNCTIONS 


Representations as series are: 
HOScheats Sea) 
: k=l kk} , 


ms oe xk 
Ei (x) = C+Inx+ —_— x > 0); 
(x) el (x => 0) 


li@) = C+In(—In.x) + 5 ae @<x <1); 
li(@) =C+Inin x+y eas («> D; 
io) = - $+ 3 (sg 

ci(x) = C+inse F (- ge. 


Here, C = 0:57721 56649... 
Approximate formulae (for small values of x) are: 


li) = — : 
In — 
Si(x) = x; 
4 
si(x) = x- 55 


Ci(x) = Ei(x) ~ Ei(—x) = C+Inx. 


Asymptotic formulae (for large values of x) are: 


a peliee rea ‘ 
x x Pe tere} 


ee 3f 5! 
+ 
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(6.408) 


(6.409) 


(6.410) 


(6.411) 


(6.412) 


(6.413) 


is Euler’s constant (see p. 310), 


(6.414) 
(6.415) 
(6.416) 


(6.417) 


(6.418) 


(6.419) 


354 MATHEMATICAL ANALYSIS 


< sin x 2! 4! 
Cl (x) = ( ~< = )- 
_ osx fll 3! Ea _ sinx 
x x «wx ae 


Ei (x) & =; 


x 
Ei(—x) = —. 


Some numerical values are: 
Ei(—1) = —0-21938 3934... . 


Ei (1) = 189511 7816... . 
li (1-45136 92346...) = 0. 


Some limits are: 


lim si(x) = —2z; 
x—> 00 

lim ci(x) = + ai; 
x—> oo 


lim [xsi] =0 (e < 1); 
> +o 


lim [xciQ] =0 (<); 
X—> + co 
lim e-* Ei(x) = 0; 
e-> +o 
lim xe™* Ei (x) = 1. 
> +00 


Some integrals are: 
a2 : l—e~m 
} Ei (—mt) dt = x Ei (—mx)— ee 


0 


ee ghd in Tak 
P gp 


(6.421) 


(6.422) 


(6.423) 
(6.424) 
(6.425) 


(6.426) 
(6.427) 
(6.428) 


(6.429) 


(6.430) 


(6.431) 


(6.432) 


(6.433) 
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ap 2==98 


sannrane 


———ee X 
Fic. 9. Integral functions: the sine Si(x), cosine Ci(x), logarithm li (x) and expo- 


nential functions Ei(—x) and Ei(x). 


Fic, 10. The integral exponential function Ei) and the integral logarithm li(x). 
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os aor 000! 
08 o wee 
06 
a2 ads, a 
04 

fa} Q00003 
a3 jo 
a2 - 

7 

pe 0 000008 
00000: 
006 a er 
005 
au 0004 000004 
003 T 
as 0002 000000: 
Ais 01 7 


a 2 8 4 § 6 F 8&6 9 WW H 


—_— xX 


Fic. 11. The integral exponential function —Ei(x). 


{ “eat gdl = 22 arctan’ (6.434) 
. q q 


i * cos t Ci (1) dt= iN sintsi(dt= —; (6.435) 
0 0 


” c(t) dt = i "PW at = 4; (6.436) 
0 0 : 2 
[ Cid) si(Ndt = —In2; (6.437) 
0 
ss _ x= for « > B, 
i ci (at) ci (Bt) dt = { si (at) si (fr) dt = | ™ (6.438) 
° # for « < B. 


The graphs of the integral functions are shown in Fig. 9, 10 and 11. 
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3. The error function 


DEFINITION. The error function is defined as the function 
efx = mal edt [erf(@) = 1] (6.439) 
war 


It is often defined as 


Beg IE ee a (6.440) 
do 


or (by S.N. Bernshtein) as 


Gj sane ene eee ee *_). (6.441) 
me FB] 2 2 \W2y 
The following notations are also encountered: 
2 oo 
erfex = l-erfx = —=] edt, (6.442) 
ae 
L@) = i e-P d= ae erfe x. (6.443) 
Fe . 
Relationships between the functions erf x and g(x) are: 
©(x) = erf (—~ 7 (6.444, 
ent) one 
erf x = O(x ./2). (6.445) 
The derivatives of the error function are: 
d 2 
——(erf x) = —= e-**; 6.446 
ets) = (6.446) 
d 2 -= 
eae =) flies 
dk D(x) fz e 3, (6.447) 
The integral of the error function is: 
eiedes wet ees 2G, (6.448) 
Ve 
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Other integral forms are: 


en gael (6.449) 
erfx = — —= at; a 
Vaso Vt 
aes { * prvay? gy (6.450) 
Vm Jo 
of (SHE ae dt (6.451) 
¢ IX) = _ = . \ 
(V9) a o Vg 
10 TT eS 
oof TTT 
a A 
08 
a7 
asH 
15 SERRE 
ag EReS 
O04 
Gs aa 
Cre am 
az 


Fic. 12. The error function erf x = va) { e? dt, 


The representation as a series is 
xeh~1 aa QRy2h+1 
QR-DEAD! Yar eo Qk DN 


(6.452) 


efx= 4 § (- 11 


War 


Asymptotic formulae are: 


erf (/%) = 1-e* § (-1) +<=R,, (6.453) 


i 
k+— 
+? 
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r(r +3) 


1 
a+= 
2 


where 


» x= xelP and g?<2®; (6,454) 
|x| cos “7 


x8 


e 1 1.3 1.3.5 
erfc x ~ rab 32 tae eet ite ‘| (6.455) 


The graph of the function erf x is shown is Fig. 12, which also 
gives the graphs of tanh x and 1— e* for comparison. 


4. Fresnel integrals 


DEFINITION. The following functions are called Fresnel integrals: 
the Fresnel sine integral, 


S(x) = (zi. sin t? dt [sc oo) = 5} (6.456) 


the Fresnel cosine integral, 


C(x) = (ei. cos f? dt Ke oo) = z\- (6.457) 


The following definitions of the Fresnel integrals are also 
occasionally encountered: 


= 
Stax) =| sn Zea=s{ /Zx}, (6.458) 
ane) 2 
eo 
C*(x) -| cos = t2dt = c( zx), (6.459) 
Pais) z 
Other integral forms are: 
1 (* sint 
SQ) = ral mn ye (6.460) 
2x 0 t 


Gee | eee (6.461) 
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a # x 
S(xy) = Jon sin (72?) dt; (6.462) 
Cixy) = = * cos (y71*) dt. (6.463) 


ral 


The representations as series are: 


+3 
S() = Eo ay =i (6.464) 


ak+1 
C(x) = (22 Ee Y oEaeeiy =D" (6.465) 


The asymptotic formulae are: 


Sx) = + ee cos x2®+0 (=) (x +); (6.466) 
C(x) = st = sin x2+0 (=) (x +). (6.467) 


The connections between the Fresnel integrals, Bessel functions 
and the error function are: 


SQ) = = ae ay (t) dt; (6.468) 


C(x) = = 173 5 Oa; (6.469) 


C(z) +iS(z) = if erf (#)- Ji. edt; (6.470) 


C(z) iS) = a erf (2/7) = ei. erittg, (6.471) 


Some limits are: 


lim S@ = lim CQ) = (6.472) 


x—> + co x—> +00 


lim {+{ se) —]} = lim ee =0 (e< DD. 
X—> + 00 x—> +00 


(6.473) 
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Fic. 13. The Fresnel integrals S(x) and C(x), x?=z, 
Some integrals are: 

'p gen?) 

I Sead = psig eh. (6.474) 
° a [2% 
'p ; 252’ 

| Clax) de = pC(ap) ~ 2 2, 
0 a 


ora (6.475) 
=r 4 2/2 cos $ sin a 
i} Es st | sin 2px dx = — = 3 (p > 0); 
(6.476) 
ory 2/2 sin 3 sin 2 
i [z-o| sin 2px dx = — Pg oe (p > 0). 
(6.477) 


The graphs of the Fresnel integrals are shown in Fig. 13 
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5. Gamma and beta functions of Euler 


The so-called Euler B- and I’-functions are important non-elementary 
functions. They are defined by improper integrals dependent on a 
parameter; they have been carefully studied, and fairly detailed tables 
have been compiled for them. 

The fundamental properties of the functions are described below. 
All the parameters appearing in the formulae are real. The operations 
employed, of differentiation, integration, change of the order of 
integrations, summation, etc., are valid, inasmuch as the integrals 
are absolutely and uniformly convergent for the values of the 
parameters considered. 

1°. Definitions, functional equations and elementary properties 
of the I (gamma)-function of Euler. For « > 0, Euler’s gamma 
function is defined by the integral 


T@) = { * ya-le-# dx, (6.478) 

Change of the variables leads c the formulae: 
T(@) = i (= re dx: (6.479) 
T@ = * enenex dx, (6.480) 


Integration by parts of (6.478) gives 
I@ =(«-DI@-) (6.481) 

and in general, for integral n and « > 0, we have 
P(@) = («—1) @-2)...(@—n+DF@—n+)). (6.482) 

On putting « = n (integer ) in (6.482), we get 
Pn) =(2-D! (6.483) 
Continuation of the gamma function into the negative semi-axis 
is accomplished in accordance with the formula 

I(a) 


a—l 


Te@-) = (6.484) 


TQ) = Fer) (6.485) 
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first into the interval (— 1, 0), then into (—2, — 1), so that, for —n< 
<x< —(n—1), 


7 I(x+n) 
Oe x(x¢1)...@+n—1)” S789) 
whence, for 0 < « < I, 
T(e—n) = (—1)" ie) (6.487) 


(l—a)(2~-a)...(n—a)* 


The function J'(x+1) is often denoted by the symbol J7(x). 
The gamma function is discontinuous for all integral negative 
values of the argument, since it follows from (6.485) that 


lim |xT(x+1] =. (6.488) 
fSon 


It follows from (6.478) that, at points where the gamma function 
is continuous, its derivatives may be evaluated from the formulae 


I'@) = i xe—le-* In x dx, 
7 (6.489) 
LOO(a) = i x*-le-* (In x)Pdx. 
0 


Remark, An equation of the form 
F(x, y(x), y'(x), «-- YX) = 0 


where F is a polynomial in its arguments x, y(x), y’(x), «.-, ¥(X), is 
called an algebraic differential equation of the nth order. A function 
y(x) is described as hypertranscendental if it is not a solution of any 
algebraic differential equation with polynomial coefficients. The 
function (x) is hypertranscendental. 

For instance, y(x) = sin x is a solution of the algebraic equation 
y?+y = 1, so that it is not a hypertrascendental function. 

An elementary asymptotic formula. It follows from the inequality 
with 0 < « < 1) 


n@D(n)— e~tnttn-i < T(a+n) = 


= { ca < n—1['(n+1)per"n*+"—-1 (6.490) 
0 n 
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that 
as = 1. (6.491) 


The representation of the gamma function as a series is mentioned 
in Chapter III, § 3. sec. 16. 

Expressions for I(«) and I'-*() as infinite products. If we use 
(6.491) and replace [{a+n) in accordance with (6.482), we arrive 
at the Euler—Gauss formula 


n! 


fa) i eee? en 
or 
T(@) = limn® cas, (6.493) 
n> co Tl (% + v) 
v=0 


We can obtain from these last formulae, on making use of the 
transformation 


n 

ca 
ais = 27 (1+4)- 

nine Wg v 

x P 
~alnn+ — on a 
=e vai” «[] ((: +2)e*), 
v=] v 


the Weierstrass formula 
1 ea a er 
— = [-'y) = 0h, = ry (6.494) 
Ee as i ((1 +$)e ) 
where C is the Euler—-Mascheroni constant (6.56). 
The formula for the complement 


I@Pri-2«) = (6.495) 


sin 7a 


follows from (6.493) and the formula 


sin za P a of 


N—> co v=] 
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In particular, it follows from (6.495) that 


r(4) ae (6.496) 


Since we have, from the formula for the complement, 


1 2 n—-1\7? qn-k 
[ea eG)r( n | no eee FON . n—-l ? 
sin — sin —... sin % 
n n n 


(6.497) 
we obtain, in view of the relationship 
n-1i _ kn n 
o sin oe = 9n=1 


the Euler product: 


nak 


1 2 a-1l\_ (x)? 
r(a)e(F)F( - \- Se (6.498) 


The multiplication formula 


bad v Lats ~ha tt 
Tl 7 (« +t) = (27) 2 kK 2T(kx), x>0, k is an integer=1, 
v=0 (6.499) 


follows from (6.493). When k = 2, we get the (Legendre) doubling 
formula 
1 
Tet (: +4) = Jim2** F220). (6.500) 


The logarithm of the gamma function. On taking logarithms of (6.493) 
and passing to the integrals, we arrive at the integral form of the 
logarithm of the gamma function: 


= n n 
In al (a) = ( ae) a 


eo 0 ene — e(nt+a)x ent — e(nt+i)x 
+ ee SO de 
n=1 x x 


—o 


0 [otto] —e%) 
i x(1—e*) 


Il 


e& dx, 


in (@) = [Sst -@-ne}é. (6.501) 
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Other integral forms are: 


Oe ies _). d4p-8=(149- 
In F(a) =[) [@-m ae | = %>0, (6.502) 


ine) = [Fhe Dn > 0. (6.503) 
scan a i aie gs 1 a 


Raabe’s formula. On taking logarithms of the Euler product 
(6.498), we get 


and if 


we have 
1 
| TO ee lk fe (6.504) 
0 


The Raabe integral is obtained by differentiation with respect 
to the parameter: 


1 
J= } In P(a+x) dx = a (Ine«—I+1n /2x). (6.505) 
0 


Another expression for the Raabe integral is obtained by inte- 
gration of (6.501): 


0 ax T et e 1 
a ee 
It follows from (6.501), (6.506) that 


inte 74 = a fde dx, (6.507) 


1 1 1,1 
fe) = 5(gt-3 +): 


where 
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On introducing the Binet function 
0 
oa) = } S(xye%* dx, (6.508) 


we get an asymptotic expression for the logarithm of the gamma- 
function: 


InI() = In Va+(0 -5) Ina —a%+o(«). (6.509) 


It also follows from (6.501) and (6.506) that 


yar (« +3) = } °  F(xer® de, (6.510) 


where 


noa2(t-) 


From this we obtain an asymptotic formula for I” («+3): 


In’ (« +3) =a(ne—1) + In J2x— (2), (6.511) 
where 


,(a) = l F(x)e% dx. (6.512) 


The following relationship holds: 
O(a) = w(«)— (2x); (6.513) 


it is obtained by taking logarithms of the doubling formula (6.500) 
and substituting for In I'(«) and In (2x) in accordance with (6.509) 


and for In I” (+3) in accordance with (6.511). 
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The following formulae are due to Schaar: 


o(a) = "foyer dx = ae SS = 
= + { . as In(l—e*), (6.514) 
w(2) = | are in Or re In (1222) = 
a + | — In (1 +e"), (6.515) 


The Stirling and Gauss asymptotic formulae. By using (6.179) and 
(6.508), we can obtain the Stirling series for the Binet function: 


_ B 1, B 1 
WN) aaa aaa 
Bane 1 
ioe + Gar NGnay ams TR (6.516) 
where 
on eee : 0<6<1 6.517 
=O Gap SO! aD) 
When n = 1, 
_ ph _ 8 


and Stirling’s formula follows from (6.509): 
inte) =n Jix+(a—1)ine-aze_, 6.518) 
2 12a’ 


eee 
D(a) = fina’ te "* ee, (6.519) 


Stirling’s formula is again obtamed when « is equal to aninteger m: 


m @ 
m! = ./2am (2) glam . (6.520) 
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An asymptotic formula for @,(«) follows from (6.513) and (6.516): 
_ B ay Gee it 
on@) = a (1 Sale ae -3)3+ 


Bs ig 


Tn particular, 
a(«) = 6 oC eae = aL 0<6<1. (6.522) 


Gauss’s formula follows from (6.522): 


In r(s +4) Seles 19s Vis. (6.523) 


1 ‘ 
When n is an integer and zg = nts, a formula is obtained fora 


factorial that gives a better approximation than Stirling’s formula: 


e 
e 24n+i2 | (6.524) 


The power expansion of the logarithm of a pamne function. It 
follows from (6.481) and (6.493) that 


log [(1+a)= 


* dx a I(x) 7 afl 1 
. (Sef re. i [ - c+ 3 (F- va) |* = 


= —Ca+—R at Bb tbat Sah (6.525) 
where 
if 1 
Sp=ltgpt-.- tort: 
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The trigonometric expansion of the logarithm of the gamma 
function (Kummer’s series). If, when x€ (0, 1), 


InT(@) = B+ ¥ (a, cos Inna +b, sin 2nnx), (6.526) 
n=1 
where 
1 
= 2 InI (x) cos 2nax dx (n= 0, 1, 2,...), 
0 


(6.527) 
b, = 2 [Tin @) sin mex a (n = 1, 2, 3, ...), 
we have by the formula for the complement: 
In F(«)+In PU —«) = apt a5 2a, cos 2nma = 
= In2a— Insinax = In2x+ ¥° eas (6.528) 
whence ae 
5% =InJj2n, a, = Geel ED (6.529) 


We have from (6.502) and (6.64): 


i 
=) carl Gre x41) sin Dex de = 
1 mu \ GU _,, \ du 
ro er as mt We u maa (ea e ce 


ss (e7t— e-anmuy & = = ~ (C+1n2nz). (6.530) 


Further expansions of the logarithm of the gamma function are 


InT(l+a) = 5 cu ~ Cx 2 a — bab — wee, (6.531) 
nr ee ee 


+0 -—OQx-(5,—- nS -(,-y=- wees (6.532) 
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The logarithmic derivatives of the gamma function (the psi or 
digamma function). By definition, 


va) = FS = Zale; 
oe e+) er (6.533) 
OTe de ee 
so that 
Ya) = la) +=. 
The function (a) satisfies the functional equations: 
pl +2)— ya) = -. (6.534) 
y(a)~p(l—2) = —ntanze. (6.535) 
Gah <a ~xtanza——., (6.536) 
pd +2)-pl-2) = - mtanna+—. (6.537) 
é (4+ “)-9 (s- x) = pias: (6.538) 
yma) = mS (= +7) eames (6.539) 
TQ 


It follows from (6.492) that 


I” l = 
we) = Tey eet E(S-se) Gs 


we have 


ye) = —C+ 5 ( : v=): (6.541) 
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It follows from (6.541) that 


20 1 ‘1 
ya) = ~CH+D (| tdt— { meena) = 
ve0\Jo 0 
1-71 


= Se Naseer dt. (6.542) 
0 -—t 


On carrying out the change of variable 1+y = 171, and taking 
account of (6.63), Cauchy's formula is obtained: 


(2) = { ° [e~ res cee a>0. (6.543) 
0 


Other integral forms are: 


co pat p~ta 
w(x) = -c+/ ce dt, 2 > 0; (6.544) 
‘ l-e 
Be Sa ae. eG Hess 
ES Me ert pe , ; 
1 bo t dt 
ya) = Ina— 7 2 » PART ° (6.546) 
tf oy pend 
(a) -| (ae) He es (6.547) 
0 


ya) = I; [(d4+)7-( +) 4-6, a>0. (6.548) 
ft) 


Some particular values of the gamma function and its derivatives 
are: 


Ti) =7Q =1; (6.549) 
(0-5) = fr; (6.550) 
I(—05) = —2 x; (6.551) 
r(x +4) =F anne (6.552) 
1 De 
r(}- ") =(- DIF ee) 


yd) = -— C; (6.554) 


13 * 
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(6.555) 


(6.556) 


(6.557) 


(6.558) 


(6.559) 


The-graphs of I(x), (x), 1/L'(x) and 1/H(x) are shown in Fig. 14 


and 15. 


oh 


2 


a ay a ee TY 


Fic. 14, The gamma functions I(x) and I'(x+1) = A(x). 
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sassep"ccsasee 


Fic. 15. The functions 1/I(x) and 1/1(z). 


Properties uniquely defining the gamma function. A function F(x), 
continuous along with its derivative for x > 0, is a gamma function 
I(x) if it satisfies any one of the groups of conditions enumerated 
below: 


lL (a) Fat) = ae 
(b) F(x)F (1-x) = 


sin mx? 7 

(c) repr (x +4)- — F(x). 
Il. (a) Fx+1) = xF@), 

(b) FopF( x +4)- V™_ F(x), 


2 Q2x-1 
(c) F(x) +0 for x>0. 


Ql. (a) FQ) = 1, 
(b) F(x+1) = xF(x), 
(c) F(x) is a logarithmically convex function for x >0 (see 
Chapter I, § 3, sec. 17). 


IV. (a) F() = 1, 
(b) Fx+l) = xF(), 
(c) (e/x)*F(x) is decreasing for x > 0 (or x > M). 
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2°, Definitions, functional equations and elementary properties of the 
B (beta)-function of Euler. Euler’s beta function is defined by the 
integral 


Ba, B= [sce dx, a>0, B>=0. (6.560) 
0 


Integration by parts leads to the functional relationships 


Bi f= 2 73% 8-1, B>1, (6.561) 
B(a, 8) = eoet B(a-1, f), «>. (6.562) 

The B-function is symmetrical: 
Bq, 8) = B(B, a). (6.563) 


The connection between the binomial coefficients and their general- 
ization. Since, when m and 7 are positive integers, 


_ @—1)'@n—1! 
Bim, n) = (ne De (6.564) 
we have 
1 _ {mtn-l\ | 
nB (m, n) ={ m—1 ): 
(6.565) 
1 _ {mtn-1 ; 
mB (m,n) =( n—l ): 
whence, when «> 0, 8>0, 
at+b—-l\ | 1 
( ae )- wen ane (6.566) 
a+B-1\ 1 
( ae \= man (6.567) 


An expression in terms of the gamma function. On replacing x in 
(6.560) by y/(1+,), we arrive at the formula 


yoridy 


Bae? (6.568) 
9 U+yerF 


B(@, 8) = 
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whence 


pa [~ Petty d 
Be, Ate+6) = |” 


= is e-s+4) yo +B—1 ya-1 ax dy = 
ovo 


= i. e-8x0-1 dx le e-=U(xy)9~ld(xy), 
0 i) 
and finally, 
_ TI) 
Bia, Py = Tass)" 


Other integral forms are: 


a]: 


BO 6) = 2/ 


o 


2 
sin2*—1p cos*F-lpdp; 


12 
Ba, 8) = af sin?*y cos*¥odp, L> -5 p> ar 
0 


oo fel d oo f2a-d d 
Be) = | oie (=2(" apa t 
a>0, B>0; 
‘1 pod ph+1 
B@,p)= [Ste a, a> 0, B>0; 
0 d+) +B 


i 1—1)*-1 dr 
Bla,a)= ga | 


Representations as a series and infinite product: 
1 Sp bO-)..- 6-0 2 
Bia, f) = B oy 1) nian)? B > 0; 


cs k(a@+B6+k) 
Bb) = I @FRE+h 


(6.569) 


(6.570) 


(6.571) 
(6.572) 


(6.573) 


(6.574) 


(6.575) 


(6.576) 


(6.577) 
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6. Bessel functions 


The Bessel functions of the first kind J,(x) are defined as the 
coefficients of the power expansion in the variable ¢ of the generating 


Aye, 


1 1 x x 
( 2 
e? ges = e2 'e 3 


on a 
function e 


i, 2 fo (—)Pxrtsrr-s _ °° : 
= Py p» presi PP J,(x)t™ (6.578) 
oo — 1)8xnt2s 
F(X) = Rae —e <x<-+0, (6.579) 
Joins) = (~1)°F,@)- (6.580 


The Bessel functions of an imaginary argument J,(x) are defined 
from the relationship 


1 1! oo 
er NEL SY Teor; (6.581) 
n=—oo 
oo xn+ar 
In@) = ds 2m+28(n + s)1s!” (G38) 
I(x) = i-* In(ix), (6.583) 


Lon(X) = iJ__(ix) = (1), (ix) = i lix) = I(x). (6.584) 


The trigonometric forms of the generating functions. It follows 
from (6.578) with ¢ = e’? that 


emsin @ = J,(x)+2i/,(x) sing + 
+ 2J,(x) cos 2p + 2iJ,(x) sin 29 + 2J,(x) cosdg+..., (6.585) 


whence 


cos (x sin 9) = Jo(x) +2 F. Jog(x) cos 2kp, (6.586) 
kel 


sin (x sin g) = 2 . Jona a(x) sin (2k + 1)y, (6.587) 
k=0 
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and similarly, 


eit cos? = Jy(x) +2 ¥ i*J,(x) cos sp, (6.588) 
sal 


cos (x cos @) = Jo(x) +2 F (—1)'aq(x) cos 2kp, (6.589) 
k=1 


sin (x cos g) = 2 ¥) (—1)¥Jop43(x) cos (2k+1)p. (6.590) 
é 


Bessel’s integral. On regarding (6.586), (6.587), (6.589), (6.590) as 
Fourier expansions, we get 


f cos np cos (x sin g) dp = (6.591) 


ae for n= 2k, n= 0, 
0 


0 for n= 2k+1. 
0 for n=0, n, =2k, 


(6.592) 
aJ,(x) for n= 2k+1. 


{ sin np sin (x sin yp) dp = | 
0 


It follows from these formulae that 
F,(x) = ae cos (np — x sin p) dp (Bessel) (6.593) 
0 


where 7 is zero or a positive integer. 
Addition theorem. Since 


1 1 1 
ee dusty Lage —E ot-e-n) 
Y Jy(u+oyt™ = e* =e? e? = 


= by _ at Dis J.(oyt", 
we have 
Tnfute) = Yi Iedna, (6.594) 
or 


J,(u+0) = x Js) -a(0) + 


+ (—1* {Fnac t+ Inec(OJe(v)}. (6.595) 
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Similarly, 


Kut) = SY WdInas0) = ¥ Lina) + 


+ z Insc) + Ina alL(v)}. (6.596) 


Fig. 16. 


The addition theorem in Neumann’s form. It follows from Fig. 16 
that 


R= J/r? + @—2re cos y, 
Roos (p +x) = tcose+ecosf = rcosx+ocos(xn—yp+a)= 


= rcos“+oacos(x—¥), 
whence 


Tims Rees = FM (eime F (— NI (@hetvel® = 
= Lire FS (-DV@hMe™, 6.597) 
and 
TReie =F (-DInade*™*, (6.598) 
J,(R) cos np = ¥(—1,(o)Jn—i(r) cos by, (6.599) 


t 
J,(R) sin np = ¥ (—1)'41J,(0) Jn_(7) sin ly. (6.600) 
T 
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When n = 0, 
Jo(R) = Jo(R)Jo(o)A(r) cos ip (6.601) 


When r = 0, R = 20 sin5-9 = z sin 6, 


Jn(z sin 6) = a(S )+25 EG (z ) eos 218. (6.602) 


Bessel’s differential equation, which is satisfied by the Bessel 
functions J,(x), is 


ord 
abe 


Correspondingly, the J,(x) satisfy the equation 


+x +(08—72)p = 0. (6.603) 


dy 


dy i ee 
Patra G+ My = 0. (6.604) 


Recurrence relations are: 


IngiX) = = n(x) — In(); (6.605) 

Ina) = Jul) + Jub) (6.606) 

TQ) = F Uaa— Ins (6.607) 
2n 

Ina) + Ini) = ae F(x); (6.608) 


d d 
ax (x"Jn) = XIna, Ge tn) = Xn (6.609) 


The Bessel functions of the first kind J,(x), 7 not an integer, 


1) x \n+ee 
In(x) = 3 Werniessty (2 ) (6.610) 


satisfy the differential equation (6.603). 
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A second linearly independent solution of this equation is provided 
by the function J_,(x) (1 not an integer), so that the general solution 
has the form 


y= Cn (X) + Con @), 


where C, and Cy, are arbitrary constants. The recurrence formulae 
(6.605)—(6.609) also hold for /,(x), where n is not an integer. 
Bessel functions of the first kind J (x), where » is an integer, 
n+ 
2 


are expressible in terms of elementary functions; in particular, 


J,@) = ia). ee (=) 
? “resyr(z+s+1) 


x \i 2 2 x28 De: Shi ca 
= [{— }/2 ae, ee ea xe 2x sinx 2 : 
(3) (EE 1) Gap! f2 a = sins; 
(6.611) 


2 
a (x) = = cos x. (6.612) 


Expressions for J __, (x), m any integer, can be obtained by successive 
nt+> 
2 
applications of the recurrence formulae. . 
Bessel functions of the second kind Y,(x) (Weber functions) are 
expressible in terms of Bessel functions of the first kind with the aid 
of the equations: 


Gj Stim Ix) cos va — J_,(x) 


Pies ar for n an integer (6.613) 


J n(x) cos nm— J_,(x) 
sin m7 


Y,(x) = 


for n not an integer. (6.614) 


Like J,(x), the function Y,(x) satisfies the differential equation 
(6.603), the general solution of which has the form, when n is an inte- 
ger, y = CyJq(x) + GY q(x). 
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The Macdonald function is usually taken as the second solution of 
equation (6.604): 


H Tn) In() 


Cs a 2 sin 7% 


for n not an integer. (6.615) 


The recurrence formulae are: 


Yoel) = S Ya(x) ~ ¥eQ0: (6.616) 
¥y-a@) = ¥q()+ Yas (6.617) 
Fa (2) = 5 Fnar (2) Vasa COs (6.618) 
Yaar (+ ¥n-a 0) = 2 Fy (5 (6.619) 
Ing 1) — Ip) = -= r(x); (6.620) 
Kass) — Ky) = = n(x). (6.621) 


Relationships between Bessel functions of the first and second 
kinds are: 


Tu¥nsO— Yan) = — 2s (6.622) 


Ig) Kyas(2) + Karas) = >. (6.623) 


Representations as series are: 


2 4 6 
Ifa) = 1-(3) +a (3) -an(3) tose (6624) 
3 
1a 3-2 (2) eh 
2 
= 


Y,(x) = (c +In Z) Io(x— 


Nx 
Ne 
a 
| 
te 
A 
aN 


q 
y+ weed (6.625) 


ape 
Ms 
“ID 
sil 
lS 
a 
on 
N|& 
Nee” 
isd 
3 
Mi 
co loa 
~ 
foay 
oO 
SS 
Nee 
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YQ) = z(¢+"3) 4) -% = 
sna) (2 
1-5) a) ao 
Ii) == + (=) + sri (3) +3 (=) tees (6.629) 
Rp) = - (c +n 5) ¥e9 +¥ oF ey m3 z (6.630) 

K(x) = (c+m 3) I(x) +. = 

-$ aa (zy (= t-te) 5 6631) 


where C is Euler’s constant (see § 1, sec. 1, 3°). 
Asymptotic formulae (for large values of x) are: 


Jo(x) = jz [co sin («+ x) + Qa(x) cos (« +5) 
2 4 te bed 

I(x) iz [p09 sin (= - 5) +@,(x) cos (<7) 

2 


Yi) = J 2 [ — P,(x) cos (<- =) +Q,(x) sin (« - 


y rtm) 5 6.627) 


6 
z) anes (6.628) 


3 (6.632) 


] ; (6.633) 
) ; (6.634), 
) 


| 3 (6.635) 


HX 

where 

FR 
21 (8x)? 4! (8x)* ogee 
1 13,3352 ; 

Q) = —TEt are 


P(x) = 1 


235 TGS 

Gx ai@mye 
13 12.3%5.7 

20) = Ta Stee to 


Pix) = 1+ 
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e 


e 12 92,32 12.32.52 

Pix) = =f 14+—4+——-4+—_ + ...}; (6.636) 
af 2ax Bx 2I(Bx)? —-3:1(8x)8 

2 2 32 
Hesse ff, 13 35 IGS. (6.637) 

J 2ax Bx 25(BxP 31 (8x) 
Y 
/ 


ast y (\eree 


ros 


-_ Cae a8 
AY ee 7 


(x) As (X) 4 


0) 


~06 - tt +++ 


é 10 15 20 


— x 


Fic. 18. Bessel functions of the first kind J,(x), J5(x), Jg(x), Jy—(x)- 
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Y= %(x) 


y=hi(x) 


2x 


Fic. 20. Bessel functions of the Fic. 21. Bessel functions of the 
first kind J,(x) and i,(x). second kind K,(x) and K,(x). 


_, |@ 12 1232 42,32,§8 ; 
K(x) + e * fE(-g rg Pees ae) (6.638) 


pee EE 13 143.5 14,37.5.7 _ 
ss a aaa z(1+ Be Dea Bee TT 
(6.639) 
Graphs of Bessel functions are shown in Fig. 17, 18, 19, 20 and 21. 


NOMENCLATURE 


(a _b) — The interval a< x <b 

[- «,a@) — The infinite interval x<a@ 

[b, + -) — The infinite interval x>6 

[a, b] — The segment ae#x=b 

(a, b] — The semi-interval a< x56 

{a, 5) — The semi-interval aa x<b 

(— =, 4a] — The infinite semi-interval x=¢ 

{6, + ©) — The infinite semi-interval x=6 

{x,} — The set of elements x, 

x€X — The element x belongs to the set X¥ 

x€X or x ¢ X — The element x does not belong to the set ¥ 

XcY — The set X is a subset of the set Y 

XcYorXe ¥ — The set Yis not a subset of the set Y 

AU Bor A+B — The union (sum) of sets 4 and B 

AB, or AXB, or A- B or AB— The intersection (product) of sets A and B 
BA or B—A — The complement of the set 4 with respect to the set B 


x — The strict upper bound of the set_Y 

fie S(x) — The strict upper bound of the function fon the set X 
ae — The strict lower bound of the set XY 
“info — The strict lower bound of the function f on the set X 
x 


max {a,, sg Seas a,} — The greatest of the numbers a,, a, ..., a, 
min {a;, a, ..., @,} — The least of the numbers @,, a; ..., a, 
n 
a} = {a;, dz, ..+, Gq »..} — The sequence with the general term a, 
G,,} — A double sequence 


o(a,) — a, is an infinitesimal of lower order with respect to #, if 8,=O(a,) 
O(«,) — &, has a rate of decrease not faster than 8, 
o{x), O(x) - Orders of the function x 
lim f(x) — The limit of the function f(x) as x ~ x9, x € X¥ 
x—> Xp, LEX 
E, — One-dimensional coordinate space (numerical axis) 
E,, — n-dimensional coordinate space 
£,+£,_, — The direct sum of manifolds 
e(X, Y) — A distance 
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40, 0, ..., 0) — The origin of coordinates 

S(X) =f, Xe ~. +5 X,) — A linear function, or a function of a vector (point) 
\| Xl] — The norm of the vector ¥ 

Px,x,... x, — Gram’s determinant for vectors 

L, — n-dimensional linear system 

X | E, — The vector X of E, is orthogonal to E, 

prz,X — The projection of the vector X on to FE, 

pry,X — The projection of the vector X on to the vector U, 


lim J(X) — The limit of the function f(¥), when XeM tends to A 
X— A(X € M) 
Q, — The exterior domain 


Q,— The interior domain 

F = (fy fey «++> Sn) —An operator 

Y= F(X) — The vector form of writing an operator 

Ye = F(X) = fy, Xe, ..., X_) — The coordinate form of writing an operator 

Vy = My XA AyoXet 26. $AyyX, (E= 1, 2, ..., 2) — The coordinate form of 
writing a linear operator 

Eng — The space with norm 9(X) 

Exe = Exp — The space E,y is conjugate to the space E,, 

Pa = PiPe ++ Pm — The mth partial product 

{P.} — The sequence of partial products 


es 
Tm = PmayPmane+s = TI P, — The remainder product 
n=m+1 
Xa — A double series 
RU=0 
R — The radius of convergence of a power series 
r,(x) — The remainder term of the Taylor series 


F(x) ~ x A, fe ~ The asymptotic expansion of the function F(x) 
k=o 


'b 
fg) = { f(@)g(x) do(x) - The scalar (inner) product of the functions f(x) 
and ee) 


\|f|] ~The norm of a function 


b 

if-gi = d (f—g)* do(x) — The root square deviation of functions f and g 
a 

r, f(x) — The nth-order inverse derivative of f(x) 


a as a, 
TF tb t... +h, +... 

P,/Q, — The ath convergent of the fraction 

K, K — The ordinary and singular values of the same continued fraction 

€ — The Euler—Mascheroni constant 

G -— Catalan’s constant 


—A non-terminating continued fraction 
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n| — Factorial x 

n'!! — Double factorial n 

Onm OF Of Kronecker delta. 

G.) or Cy — The binomial coefficients 

P,(x), P,(%), P,(x) — Arbitrary orthogonal polynomials 

£B,, — Bernoulli numbers 

B,(x) — Bernoulli polynomials 

Prix) = B,(x)-By 

B,C) — Bernshtein polynomials 

L°(x), L(x). L&(x) — Laguerre polynomials 

L, (x), L(x), £,(x), 1, — Legendre polynomials 

T,{x), T(x), (2) — Chebyshev polynomials of the first kind 
U,), U,00, U,(x) — Chebyshev polynomials of the second kind 
P,, x(x) ~ Chebyshev polynomials with respect to a system of points 
£E, — Euler numbers 

E,(x) ~ Euler polynomials 

H,(x), H,(x), H,(x) — Hermite polynomials 

Tis Bx), JO Wx), FI M(x), 7% W(x) — Jacobi polynomials 
|x| — The absolute value of x 

sign x — The sign of x 

[x] or E(x) — The integral part of x 

{x} — The fractional part of x 

(x) — The distance to the nearest integer 

1(x) — Heaviside’s unit function 

6(x) —The delta function 

B(«, 8) — Euler’s beta function 

I(«) — Euler’s gamma function 

Ei(x) — The integral exponential function 

Ei) - The real part of Ei(x) 

lix — The integral logarithm 

si (x) or Six — The integral sine 

cix or Cix —The integra] cosine 

erf x, p(x), Myx), erfc x, L(x) — The error function. 

F(k, p) — The elliptic integral of the first kind 

E(k, v) — The elliptic integral of the second kind 

II (k, 4, p) — The elliptic integral of the third kind 

Dik, ¢) — [Fk @) — Elk, p)I/k? 

K — The complete elliptic integral of the first kind 

E — The complete elliptic integral of the second kind 

D = (K-E)ik? 

(a), ¥(«) — The logarithmic derivative of the gamma function (the psi functions) 
S(x), S*(x) — The Fresnel sine integral 

C(x), C*(x) — The Fresnel cosine integral 


NOMENCLATURE 


J, (x) — Bessel function of the first kind 

Y,(x) — Bessel function of the second kind 

I(x) — Bessei function of an imaginary argument 
K,(x) ~ Macdonald function 


389 


2. 


3 


4 


5. 


6 


7 


8 


9 


10. 


ll 


REFERENCES 


CHAPTER I 


. I. N. BRONSHTEIN and K. A. SEMENDYAYEV, A Guide-Book to Mathematics for 
Technologists and Engineers (Spravochnik po matematike dlya inzheneroy 
i uchashchikhsya ytuzov), Fizmatgiz, Moscow (1959). English translation 
by Pergamon Press,(1963). 

. CH. DE LA VALLEE-Poussin, Cours d’ Analyse Infinitésimale, Gauthier-Villars, 
Paris-Louvain (1937-47). 

. E. Goursat, Cours d’ Analyse Mathematique, 5th ed., Gauthier-Villars, Paris 
(1942). 

. A. Ya. Dupovitsii, Axiomatic construction of the real numbers, Matemati- 
cheskoye prosveshchenie, No. 2 (1957). 

. M.A. Kartsev, The Arithmetical Principles of Electronic Digital Computers 
(Arifmeticheskiye ustroistva elektronnykh tsifrovykh mashin), Fizmatgiz, 
Moscow (1958). 

. A. N. Kotmocorov, A note on the foundations of the theory of real numbers, 
Matematicheskoye prosveshchenie, No. 2 (1957). 

. A.N. Kotmocorov, The basis of the method of least squares, Usp. Mat. 
Nauk 1, No. 1 (1946). 

M. G. KRASNOSEL’sxt1, Convex Functions and Orlicz Spaces {(Vypuklyye 
funktsii i prostranstva Orlicha}, Fizmatgiz, Moscow (1958). 

. N.N. Luzin, The Theory of Functions of a Real Variable (Teoriya funktsii 
deistvite’nogo peremennogo), Uchpedgiz, Moscow-Leningrad (1940). 

. V. Nemytsku, M. SLupskayA and A. CHErKasov, 4 Course of Mathematical 
Analysis (Kurs matematicheskogo analiza), Vol. I and II, Gostekhizdat, 
Moscow (1957). . 

. G. Porya and G. Szeco, Aufgaben und Lehrsatze aus der Analysis, 2 volumes. 
Springer, Berlin (1925); reprinted, Dover, N.Y. (1945). 


12, V. 1, SMirnov,A Course of Higher Mathematics (Kurs vysshei matematiki), 


13 


14 


Vol. I, Gostekhizdat, Moscow-Leningrad (1948). English translation by 
Pergamon Press, (1964). 

. BE. T. Wurrraxer and G. N. Watson, A Course in Modern Analysis, 4th ed., 
Cambridge Univ. Press (1940). 

. G. M. FixHrencor’ts, A Course of Differential and Integral Calculus (Kurs 
‘differentsial’nogo i integral’nogo ischisleniya), 3 volumes, Gostekhizdat, 
Moscow—Leningrad (1951, 1951, 1949). 


390 


REFERENCES 391 


15. A. YA. KHINcHIN, A Short Course of Mathematical Analysis (Kratkii kurs 
matematicheskogo analiza), Fizmatgiz, Moscow (1959). 

16. A. YA. KHINCHIN, The elementary linear continuum. Usp. Mat. Nauk. 4, 
No. 2 (1949). 


CHAPTER II 


1, A. D. ALEKSANDROV, The Interior Geometry of Convex Surfaces ( Vnutrennyaya 
geometriya vypuklykh poverkhnostei), Gostekhizdat, Moscow-Leningrad (1948). 

2. A. D. ALEKSANDROV, Convex Polyhedra (Vypuklyye mnogogranniki}, Moscow- 
Leningrad (1950). 

3. D. Hwpert and S. Conn-Vossen, Anmschauliche Geometrie, Springer, Berlin 
(1932). 

4, M.A. Lavrent’ev and L. A. Lyusterni, Foundations of the Calculus of 
Variations (Osnovy variatsionnogo ischisleniya), Vol. I, Part I, United Scientific 
and Technical Press, Moscow-Leningrad (1935). 

§. L. A. LyusteRNik, Convex Figures and Polyhedra (Vypuklyye figury i mnogo- 
granniki), Gostekhizdat, Moscow (1956). 

6. L.A. Lyusrernix, Applications of the Brunno—Minkovskii inequality to 
extremal problems, Usp. Mat. Nauk, No IT (1936). 

7. L.A. LyusTernix, The Brunno—Minkovskii inequality for arbitrary me asurable 
sets, Dokl. Akad. Nauk, 3, pp. 55-8 (1935). : 

8. L. V. KantorovicH and V. V. Novozaitov, (Editors), Linear Inequalities 
-and Associated Problems (Lineinyye neravenstva i smezhnyye voprosy); a col- 
lection of translations (Sb. perevodov), Foreign Literature Publishing House, 
Moscow (1959). 

9. G. Minxovsku, General theorems on convex polyhedra, Usp. Mat. Nauk, 
No. II (1936). 

10. V.I. Smirnov, A Course of Higher Mathematics (Kurs vysshei matematiki) 
Vol. I, Gostekhizdat, Moscow-Leningrad (1948) English translation by 
Pergamon Press, (1964). 

11. G. M. FIKHTENGOL’Ts, A Course of differential and Integral Calculus (Kurs 
differentsial’nogo i integralnogo ischisleniya), Vol. 1. Gostekhizdat, Moscow- 
Leningrad (1951), 

12. E. Hetty, A set of convex bodies with common points, Usp. Mat. Nauk, 
No. II (1936). 

13. G.E. Sumov, An Introduction to the Theory of Linear Spaces (Vvedenie v 

= teoriyu lineinykh prostranstv), Gostekhizdat, Moscow (1952). 

14. D. O. SHxtyarskul, Conditionally convergent vector series, Usp. Mat. Nauk, 
No. X, pp. 51-9 (1944). 

15. O. Scurerr and E. Sperner, Einfiihrung in die Analytische Geometrie und 
Algebra, 2 volumes, Vandenhoeck and Ruprecht, Gattingen (1948-51). 

16. I. M. YAGLom and V. G. BoLTYANsKH, Cr nvex Figures (Vypuklyye figury), 
Gostekhizdat, Moscow-Leningrad (1951). 


392 


REFERENCES 


CuarTer HI 


. YA. I. ALIKHASHKIN, A method of computing the debit for the head flow 


to an imperfect bore-hole, Vychislit. matem. No. 1 (1957). 
E. Goursat, Cours d’Analyse Mathematique, Vol. I, Gauthier-Villars, 
Paris. (1942). 


. L. V. Kanrorovicn and V.I. KryLov, Approximation Methods of Higher 


. Analysis (Priblizhennyye metody vysshego analiza), 4th ed., Gostekhizdat, 


NR 


Moscow--Leningrad (1952). : 

I. I. Privaov, Fourier Series (Ryady Furi’e), United Scientific and Technica 
Press, Moscow-Leningrad (1934). 

V.1. Romanovskit, An Introduction to Analysis ( Vvedeniye v analiz), Gosuch 
pedizdat, Tashkent, UzSSR (1939). 


. ILM. Ryzuix and LS. Grapsarem, Tables of Integrals, Sums, Series and 


Products (Tablitsy integralov, summ, ryadov i proizvedenii), Gostekhizdat, 
Moscow-Leningrad (1951). 


. G.S. SaLekHov, The Computation of Series (Vychisleniye ryadov), Gostek- 


hizdat, Moscow (1955). 

G. S. SALEKHOV, The application of Laplace transforms to the summation 
of series expanded in special functions, Uch. zap. Kazansk. ped. in-ta, No. 
10 (1955). 


. G.P. Toistov, Fourier Series (Ryady Furi’e), Gostekhizdat, Moscow-Lenin- 


grad (1951). 

G. M. FIKHTENGOL’ts, A Course of Differential and Integral Calculus (Kurs 
differentsial’nogo i integral’ncgo ischisleniya), Vol. Il and III ,Gostekhizdat, 
Moscow-Leningrad (1951, 1949). 

G.H. Harpy, Divergent Series, Clarendon Press, Oxford (1949). 

K. Knopp, Theorie und Anwendungen der unendlichen Reihen, Berlin (1924). 


CHAPTER IV 


. YA. L. Geronmus, The Theory of Orthogonal Polynomials (Teoriya orthogonal’ 


nykh mnogochlenov), Gostekhizdat, Moscow-Leningrad (1950). 


. D. Jackson, Fourier Series and Orthogonal Polynomials, Carus Monograph 


of Math, Assoc. of Am., Oberlin, Ohio (1941), 

L.N. Karmazina, Tables of Jacobi Polynomials, (Tablitsy mnogochlenov 
Jakobi), Izd. Akad. Nauk SSSR, Moscow (1954). 

S. Kaczmarz and H. Stemuaus, Theorie der Orthogonalreihen, Chelsea, 
NY. (1951). 

M. A, Lavrent’ev and B. V. SHABAT, Methods of the Theory of Functions 
of a Complex Variable (Metody teorii funktsii kempleksnogo peremennoge), 
Fizmatgiz, Moscow (1958). 

L. A. LyusTeRNIK, On the computation of the values of functions of one 
variable, Mutematicheskoye prosveshcheniye, No. 3 and No. 4 (1958). 


7 


8. 


9. 


10. 


I, 


i 


we 


n 


15. 
16, 


REFERENCES 393 


1. P. NATANSON, The Constructive Theory of Functions (Konstruktivnaya 
teoriya funktsti), Gostekhizdat, Moscow-Leningrad (1947). 

I. M. Stesin, The conversion of orthogonal expansions into continued frac- 
tions, Vychisl. matem., No. 1 (1957). 

A. S. HousEHOLDER, Principles of Numerical Analysis, McGraw-Hill, N.Y. 
(1953). 

P. L. CuepysHev, Collected papers, (Sobraniye sochinenii), Vol. I, Izd. 
Akad. Nauk SSSR Moscow (1944). 

O. PERRON, Die Lehre von der Ketterbriicken, Leipzig und Berlin (1928). 


CHaPprer V 


. I. V. ARNOLD, The Theory of Numbers (Teoriya chisel), Uchpedgiz, Moscow 


(1939). 


. J. L. F. BERTRAND, Traité d’Algebre, Hachette, Paris (1866-7). 
. ILM. Vinocrapov, Foundations of the Theory of Numbers (Osnovy teorii 


chisel), Gostekhizdat, Moscow-Leningrad (1949). 


. N.N. Voros’gev, Fibonacci Numbers (Chisla Fibonachchi), Gostekhizdat, 


Moscow (1951). English translation by Pergamon Press (1961). 


. A. Caucuy, Cours d’Analyse Algébraique, Leipzig (1864). 
. N.I. Lopacnevsxit, Algebra or the Evaluation of Finites (Algebra ili vychis- 


leniye konechnykh), Vol. TV of the complete works, Gostekhizdat, Moscow- 
Leningrad (1948). m 


. N,N. Maraxuyev, Elementary Algebra (Elementarnaya algebra), Vol. 1, 


Theory, (Teoriya), Moscow (1903). 


. A.A. MARKOV, Lectures on Continued Fractions (Lektsii o nepreryvnykh 


drobyakh), See Collected works on The Theory of Continued Fractions and the 
Theory of Functions that Least Deviate from Zero (Izbrannye trudy po teorii 
nepreryynykh drobei i teorii funktsii, naimenee uklonyayushchikhsya ot nulya) 
Gostekhizdat, Moscow-Leningrad (1948). 


. A. MEsHKov, A Course of Higher Algebra (Kurs vysshei algebry), Part I, 


SPb (1862). 


. M. V. Ostrocrapsxi1, Lectures on Algebraic and Transcendental Analysis 


(Lektsii algebraicheskogo i transcendentnogo analiza), First Year, SPb (1837). 


. P.RosHcHin, Notes on the differential and Integral Calculus (Zapiski po 


differential’ nomu i integral’nomu ischisleniyam), Part 1, SPb (1888). 
B. I. SeGaL, Continued fractions, Matematicheskoye prosveshcheniye, No. 7 
(1936). 


. T. 1. Stiecryes, Recherches sur les fractions continues oeuvres, 2, (1894). 
. A. K. Susuxevicu, The Theory of Numbers (Teoriya chisel), Khar’kov, 


Izd. Khar’k. ui-ta (1954). 

K. Ferser, Arithmetic (Arifmetika) (1914). 

A.YA. KHINCHIN, Continued Fractions (Tsepnyye drobi), Gostekhizdat, Mos- 
cow-Leningrad (1949). 


394 


17. 


18, 


_ 


on 


10. 
1k. 


REFERENCES 


A. Ya, KxIncHIN, Elements of the theory of numbers (Elementy teorii chisel) 
Encyclopedia of Elementary Mathematics, Book I (Entsiklopediya elementarnoi 
matematiki, Kniga pervaya), Gostekhizdat, Moscow-Leningrad (1951). 
A.N, Krovanskit, The Application of Continued Fractions and Generalizations 
of them to’ Problems of Approximate Analysis (Prilozheniye tsepnykh drobei 
i ikh obobshchenii k voprosam priblizhennogo analiza), Gostekhizdat , Moscow 
(1956), 


. A.N. KHOvANSKH, Euler’s works on the theory of continued fractions, 


Istor. matem. issled. No. 10, 305~326 (1957). 


. N. G. CHEBoTarev, The Theory of Continued Fractions (Teoriyanepreryyaykh 


drobei), Kazan’ (1938). 


. L.D. Esxry, A note on Euler’s algorithm for the extraction of roots (Ob 


algoritme Eilera dlya izvlecheniya kornei), Uchen. zap. Kazansk. un-ta 115, 
book 14, pp. 139-43 (1955). 


. L, D, Esxin, The problem of the nature of the convergence of Euler’s algorithm 


for the extraction of roots, Zz. vyssh. uchebn. zaved., Matem. 4 (5), pp. 275-8 
(1958). 


CHAPTER VI 


. CH, DE LA VALLEE-Poussin, Cours d’Analyse Infinitésimale, Gauthier-Villars 


Paris-Louvain (1937-47). 


. ILM. Gev’FAND and G.E.SHILov, Generalized Functions and Operations 


on them (Obobshchennyye funktsti i deistviya nad nimi), Fizmatgiz, Moscow 
(1958). 


. A.O, GEL’FOND, The Calculus of Finite Differences (Ischisleniye konechnykh 


raznostei), Gostekhizdat, Moscow-Leningrad (1952). 


. 1S. GRADSHTEIN and 1, M. Ryzuix, Tables of Integrals, Sums, Series and 


Products (Tablitsy integralov, summ, ryadov i proizvedenii), Gostekhizdat, 
Moscow-Leningrad (1951). : 

D. IVANENKO and A. SoKOLov, The Classical Theory of Fields ( Klassicheskaya 
teoriya polya), Gostekhizdat, Moscow-Leningrad (1949). 


. V. A. Kupreiavisev, The Summation of Powers of Natural Numbers and 


Bernoulli Numbers (Summirovanie stepenei chisel naturalnogo ryada i chisla 
Bernoulli), United Scientific and Technical Press, Moscow-Leningrad (1938). 


. E. LANDAU, Einfiihrung in die Differentialrechnung und  Integralrechnung, 


Noordhoff, Groningen (1934). English translation: Chelsea, N.Y. (1951). 


. E.T. WHITTAKER and G.N. Watson, A Course in Modern Analysis, 4th 


ed., Cambridge Univ. Press (1940). 


. G, M. FIKHTENGOL’Ts, A Course of Differential and Integral Calculus (Kurs 


differentsial’nogo i integral’nogo ischisleniya), Vol. I, Il, II, Gostekhizdat, 
Moscow-Leningrad (1951, 1951, 1949). 

G.H. Harpy, Divergent Series, Clarendon Press, Oxford (1949). 

E. CesAro, Elementares Lehrbuch der algebraischen Analysis und der Infinitesi- 
matrechnung, Part I, Leipzig (1904). 


REFERENCES 395 


12. E. CesAro, Elementares Lehrbuch der algebraischen Analysis und der Infinitesia 
malrechnung, Part T1, Leipzig (1904). 

13. Ya. N. SPrELREIN, Tables of Special Functions (Tablitsy spetsial’nykh funktsii), 
Parts I and 0, GTTI, Moscow-Leningrad (1933). 

14, E. JAHNKE and F. Empe, Funktionentafeln, Chelsea, N.Y. (1951). 

15, H. BATEMAN, Higher Transcendental Functions, N.Y. (1953). 

16. N. E. N6rLunp, Vorlesungen tiber Differenzenrechnung, Springer, Berlin (1924). 


INDEX 


Abel’s test for convergence 104 
Abscissa 2 
Absolute value 2 


Argument of a function 10 


Basis 
of Euclidean space 172 
of a linear system 43 
orthogonal 50, 173 
orthonormal 50 
Schauder’s 339 
Bernoulli 
continued fractions 245 
numbers 322-32 
polynomials 153, 327--32 
Bernshtein polynomials 320 
Bessel 
function 181, 377-85 
inequality 173, 189 
integral 378 
Beta function 317, 375-6 
Binet 
formula 321 
function 367 
Body 55 
convex 72-84 
reciprocal 80 
Bolzano-Cauchy test for 
gence 21 
Boundary 55 
Bounds, upper and lower 
of a function 11, 60 
of a sequence 17 
of a set 6 
Brunno-Minkovskii inequality 83 


conver- 


Catalan’s constant 312 

Cauchy 
convergence test 
formula 372 


88, 89 


inequality 41 
Cauchy-Bunyakovskii inequality 177 
Cesaro summation 145 
Chebyshev 

polynomials 

weight 210 
Chebyshev—Laguerre weight 211 
Chebyshev-Hermite weight 211 
Christoffel’s formula 207 
Circle of convergence 130 
Coefficient 

Fourier 136, 173, 189-91 

binomial 317-20 
Complement of a set 6 
Completion 9 
Component of an operator 66 
Cone 81 

tangent 82 
Constant 

Catalan’s 312 

Euler—-Mascheroni 310 
Contraction of a continued fraction 

245 
Convergence 

absolute 57, 90 

conditional 56, 90 

of continued fractions 261-9 

of double series 109-17 

of Fourier series 133-6 

of infinite products 105~9 

of power series 123 

of sequences, tests for 

of series, tests for 
Abel’s 104 
Bolzano-Cauchy 21 
Cauchy’s 88, 96 
d’Alembert’s 89, 95 
Dirichlet’s 104 
Ermakov’s 102 
Gauss’s 99 
Lobachevskii’s 102 
Raabe’s 97 


151, 223-40 


88-104 


397 


398 INDEX 


improvement of 157-61 
mean 33, 191 
uniform 31, 61, 261 
tests for 118-9 
Convergent 204, 242 
Coordinate 2 
of a vector 40 


6 (delta) function 343 
d’Alambert’s convergence test 89 
Dedekind section 7 
Denominator, partial 244 
Dependence, linear 43 
Difference of two sets 6 
Dini-Lipschitz condition 219 
Dirichlet’s convergence test 104 
Domain 55 

convex 72 

of definition of a function 10 

of definition of an operator 65 


Envelope 
convex 73 
linear 48 
passage to the limit 65 
Ermakoy’s convergence test 102 
Error function 357-9 
approximate expansion 281 
Estimate, integral 153-6 
Euler 
constant (Euler-Mascheroni) 310 
formula 308 
numbers 332-6 
product 365 
Exponential function 273, 277, 351, 
352, 354, 355, 356 
Extension of continued fraction 245 


Factorial 315 
divisors of 316 
double 315 
Fibonacci numbers . 231 
Form, linear 45 
Formula 
Binet’s 321 
Cauchy’s 372 


Euler’s 308 
Gauss’s 316, 369 
Laplace’s 323 
Machin’s 305 
quadrative 204 
Raabe’s 366 
Rodrigue’s 213, 220 
Schaar’s 368 
Stirling’s 316, 368 
Wallis’s 305 
Weierstrass’s 364 
Fourier 
coefficient 136, 173, 189-91 
series, trigonometric 132-9 
Fractions, continued 201-4, 
241-303 
and matrices 287-98 
arithmetical 252 
associated with a series 203 
contraction of 245 
convergent 261 
corresponding to a series 255 
equivalent to a series 255 
essentially divergent 261 
even 13 
expansion of power series in 271-2 
extension of 245 
non-essentially divergent 261 
of Daniel Bernoulli 245 
of Stieltjes type 203 
ordinary 244 
ordinary value of 246 
periodic 254 
in the limit 268 
regular 252 
singular value of 247 
tests for convergence of 261-9 
transformation of 244-5, 247-52 
uniformly convergent 262 


Fresnel integrals 359 


Function 

Bessel 181, 377-85 
of first kind 380 
of second kind 381 

beta 317, 375-6 

bilinear 46 

Binet 367 

concave 36 

continuous 29, 58 


INDEX 399 


convex 35, 73-6 


delta 343 ‘ 
discontinuous 29 
error 357-9 


approximate expansion as 281 
exponential, integral 277, 351, 352, 
354, 355, 356 
expansion as continued fraction 
273 
gamma 362-74 
continued fraction approximation 
for 282 
incomplete 278 
generating 151 
for Bernoulli polynomials 327 
for Chebyshev polynomials 225 
for Euler polynomials 334 
for Jacobi polynomials 221 
for Laguerre polynomials 235 
for Legendre polynomials 216 
Haar 181 
Heaviside 341 
hypertranscendental 363 
integral 351-6 
inverse 13 
jump 60 
Laplace 185 
left continuous 29 
logarithmically convex 36 
linear 45 
Macdonald 382 
monotonic 34 
odd 13 
of complex variable 130 
of several variables 57 
orthogonal 177, 184 
Pearson 210 
periodic 14, 62-4 


piecewise 
linear 337-45 
smooth 133 


polygonal 338 

Rademacher 340 

right continuous 29 
smooth 133 

square integrable 177 
uniformly continuous 30, 59 
vector 57, 67 

Weber 381 


weight 178 
Functional 31 


Gamma function 362-74 
continued fraction approximation 
282 
incomplete 278 
Gauss 
convergence test 99 
formula 316, 369 


‘Gram determinant 46, 186 


Haar function 181 
Hahn~Banach theorem 79 
Half-space 72 
Heaviside function 341 
Hermite polynomials 236-7 
Hyperpiane 48 

of support 76, 79 


Image 14 
Independence, linear 43, 187 
Inequality 
Bessel’s 173, 189 
Brunno~Minkovskii’s 83 
Cauchy’s 41 
Cauchy-Bunyakovskii’s 177 
for e 309 
for 307 
triangle 40, 76 
Infinitesimal 33 
Integral 
Bessel 378 
elliptic 346-51 
of first kind 346 
of second kind 346 
of third kind 346 
Fresnel 
cosine 359 
sine 359 
Raabe 366 
Intersection of sets 5 
Interval 4 
closed 5 
infinite 5 
semi-closed 5 


400 INDEX 

Jacobi irrational 1 
polynomials 219-23 matural 4, 
weight 210 transcendental 1 


Laguerre polynomials 233-5 
Laplace 

formula 323 

function 185 

transform © 150 
Lebesgue 

function of orthonormal system 

209 

integral 171 
Legendre 
polynomials 
weight 211 
Limit 

lower 24 
of a convex body 73 
of a function 28 
point 19, 55 

upper 24 


151, 214-9 


Macdonald function 382 
Machin’s formula 305 
Majorant of a series 
Manifold 

linear 47 

of constancy 62-4 
Mapping 13, 66 
contraction 70 
symmetric 83 
Metric 39 

Euclidean 39 
Metrization 54 
Modulus 2 
complementary 346 


89, 90, 118 


Norm 33 

of a function 179 
of a vector 41, 172 
Number(s) 

algebraic 1 
Bernoulli 322-32 
Euler 332-6 
Fibonacci 321 


Numerator, partial 241 


Operator 65 

continuous 66 

linear 67 

Order 

of Fourier coefficients 136 
of an infinitesimal 33 
Origin 2 


Parseval’s equation 173, 190 
Pearson 
equation 210 
function 210 
weight 213 
Period 
of a function 15 
fundamental 63 
Point 
boundary 55, 72 
of condensation 54 
fixed 69 
interior 72 
limit 19, 55 
of sharpening 82 
singular 131 
Poisson summation 143 
Polyhedron 
convex 73 
reciprocal 81 
Polynomials 
Bernoulli 153, 327-32 
Bernshtein 320 
Chebyshev 151, 237-40 
of first kind 223-30 
of second kind 230-3 
Hermite 236-7 
Jacobi 219-23 
ultraspherical 220 
Laguerre 233-5 
Legendre 151, 214-9 
of second kind 202 
orthogonal systems of 197-240 
convergence of Fourier series in 


INDEX 401 


207-10, 218, 228, 232 
recurrence relations for 
221, 224, 231, 234, 236 
Power moments 200-1 
Power series 120-9 
differentiation of 123 
integration of 123 
Pre-image 150 
Process 
iterative 69 
Schmidt orthogonalization 188 
Product 
Euler 365 
infinite 105 
convergence of 105-9 
inner 41, 176-9 
of sets 5 
scalar 41, 176-9 


Quotient, partial 241 


Raabe 

formula 366 

integral 366 
Rademacher function 340 
Radius of convergence 121 
Range of a function 10 
Relation, recurrence 

for Bernoulli numbers 322 

for Bernoulli polynomials 328 

for Chebyshey polynomials 224 

231 

for continued fractions 243 

for Euler numbers 332 

for Euler polynomials 335 

for Fourier series 199-200, 221, 

224, 231, 234, 236 

for Hermite polynomiais 236 

for Jacobi polynomials 221 

for Laguerre polynomials 234 

for Legendre polynomials 215 
Remainder term 

of a double series 114 

estimates of 93-4 

of a series 92 

of Taylor series 123-6 
Rodrigue’s formula 213, 220 
Root square deviation 179 


199, 


Schaar’s formula 368 
Schauder’s basis 339 
Schmidt orthogonalization process 
188 

Section 

Dedekind 7 

golden 321 
Segment 5 
Sequence 

confinal 8 

convergent 20 

deita-shaped 34¢ 

divergent 21 

double 11 

equivalent 7 

functional 30 

fundamental 7, 21, 54 
iterative 26, 67 

monotonic 18 

numerical 16 

recurrent 26 

uniformly distributed 25 
Series 86-169 

absolutely convergent 90 
alternating 90, 103 

asymptotic 140-2 
conditionally convergent 90 
convergent 87, 99 

divergent 87 

double 109-117 

Fourier 132-9, 191-4 

of functions 117-46 
Harmonic 89 

Kummer’s 370 

Leibniz’s 305 

negative 90 
orthogonal 
positive 90 
recurrent 298 

use in solution of equations 

298-300 

semi-normal 203 

Stirling’s 282, 316 
trigonometric 132-40, 161-9 
vector 56 
Set 4 

bounded 6 

closed 55 

complete 8, 9 

convex 72 


170-240 


402 INDEX 

Lebesgue 12 p-adic 2 

open 55 

Space 

conjugate 78 Transformation 70 
Euclidean 39 Abel’s 161-2 
Hilbert 170° Kummer’s 156-7 
n-dimensional 39 of continual fractions 244 
linear 54 orthogonal 50 

vector 40 similitude 83 


Stirling’s formula 316, 368 
Stoltz’s theorem 247 
Subset 5 
Sum 
generalized 142-6 
of series 86 
of sets 5 
partial 56, 86 
Summation of series 
Cesaro 143 
generalized 142-6 
numerical 146-69 
Poisson 143 
Support 
function 77 
hyperplane 76, 79 
System 
binary 3 
biorthogonal system of functions 
51, 194-7 
closed 190 
decimal 2 
linear 42 
orthogonal systems 
of function 172-240 
of polynomials 197-240 
of trigonometric functions 174 


Uniform convergence 51 
test for 32 
Union of sets 5 


Value 

ordinary 246 
Singular 246 
Vector space 40 


Wallis’s formula 305 
Weber function 381 
Weierstrass’s formula 364 
Weight 176 

Chebyshev’s 210 
Chebyshev-Hermite’s 211 
Chebyshev-Laguerre’s 211 
function 176 

integral 178 

Jacobi’s 210 

Legendre’s 210 
Pearson’s 213 


Zero, asymptotic 142 


Vol. 
Vol. 
Vol. 
Vol. 
Vol. 
Vol. 
Vol. 


Vol. 
Vol. 
Vol. 
Vol. 
Vol. 
Vol. 
Voi. 
Vol. 
Vol. 
Vol. 
Vol. 
Vol 
Vol. 
Vol. 
Vol. 
Vol. 


Vol. 
Vol. 
Vol. 
Vol. 
Vol. 
Vol. 
Vol. 
Vol. 


= 


= 


Vol. 
Vol. 
Vol. 


OTHER TITLES IN THE SERIES IN PURE 
AND APPLIED MATHEMATICS 


1. WALLAcE—An Introduction to Algebraic Topology 
2. Pepor—Circles 
3. Spain—Analytical Conics 
4. MIKHLIN—ZJntegral Equations 
5. EGGLESTON—Problems in Euclidean Space: Application of Convexity 
6. WaALLACE—Homology Theory on Algebraic Varieties 
7. NosLE—Methods Based on the Wiener-Hopf Technique for the Solution 
of Partial Differential Equations 
8, MIKUSINSKI—Operational Calculus 
9, Hetne—Group Theory in Quantum Mechanics 
10. BLAND—The Theory of Linear Viscoelasticity 
11, KurrH—Axiomaties of Classical Statistical Mechanics 
12, Fucus~—Abelian Groups 
13. Kuratowski—Zntroduction to Set Theory and Topology 
14, Spain-—Analytical Quadrics 
15. HaRTMANand Mixusinski-~Theory of Lebesgue Measure and Integration 
17. Kuratowsxi-—ZIntroduction to Calculus 
18. Geronimus—Polynomials Orthogonal on a Circle and Interval 
19. Erscorc—Caleulus of Variations 


. 20. ALEXITS—Convergence Problems of Orthogonal Series 


21. Fucus and Levis—Functions of Complex Variable, Volume IT 

22. GoopsTeIN—Fundamental Cancepts of Mathematics 

23. KeEnE—Abstract Sets and Finite Ordinals 

24. Drrxin and Prupnikov—Operational Calculus in Two Variables and its 
Application 

25. VexuA—Generalized Analytic Functions 

26. AmiR-Moez and Fass—Elements of Linear Spaces 

27, GRADSHTEIN—Direct and Converse Theorems 

28. Fucaus—Partially Ordered Algebraic Systems 

29. PostNikov—Foundations of Galois Theory 

30. BERMANT—A Course of Mathematical Analysis, Part IT 

31, Luxkastewicz—Elements of Mathematical Logic 

32. VuLikH—lIntroduction to Functional Analysis for Technologists and 
Engineers 

33 Pepor—An Introduction to Projective Geometry 

34. Timan—Theory of Approximation of Functions of a Real Variable 

35. CsAszAR—Foundations of General Topology 


403 


. 36. BRONSHTEIN and SEMENDYAYEV—A Guide-Book to Mathematics for 
Technologists and Engineers 

. 37. Mostowski and STARK—Introduction to Higher Algebra 

. 38. Gopparp—Mathematical Techniques of Operational Research 

. 39, TIKHONov and SAMARSKI—Equations of Mathematical Physics 

. 40. McLeop—ZJntroduction to Fluid Dynamics 

.41. Moisi, —-The Algebraic Theory of Switching Structures 

. 42, Orro—Nomography 


Vol. 43. RANKIN—An Introduction to Mathematical Analysis 


. 44. BERMANT—A Course of Mathematical Analysis, Part I 

. 45. KRASNOSEL’SKI—Topological Methods in the Theory of Nonlinear Integ- 
ral Equations 

.46. KANToROVICH and AkiLov—Functional Analysis in Normed Spaces 

. 47, Jones—The Theory of Electromagnetism 

. 48. Feyes TorH—Regular Figures 

. 49. YANo—Differential Geometry on Complex and Almost Complex Spaces 

. 50. MikHLin—Variational Methods in Mathematical Physics 

. 51, Fucus and Saapat—Funetions of a Complex Variable and some of their 
Applications, Volume I 

. 52. BUDAK, SAMARSKI and TIKHONOV—A Collection of Problems on Mathe- 
matical Physics 


Vol. 53. Gites—Mathematical Foundations of Thermodynamics 


Vol. 
Vol. 
Vol. 
Vol. 
Vol. 


ay 


. 54. SAUL’ YEV—Integration of Equations of Parabolic Type by the Method of 
Nets 

. 55, PONTRYAGIN ef al.—The Mathematical Theory of Optimal Processes 

. 56. SoBOLEV—Partial Differential Equations of Mathematical Physics 

. 57, SMIRNOV—A Course of Higher Mathematics, Volume I 

. 58. SMIRNOV—A Course of Higher Mathematics, Volume II 

. 59, SMIRNOV—A Course of Higher Mathematics, Volume III, Part 1 

. 60. SMIRNOV-——A Course of Higher Mathematics, Volume III, Part 2 

. 61. SMIRNOV—A Course of Higher Mathematics, Valume IV 

62. SMIRNOV—A Course of Higher Mathematics. Volume V 

63, NAIMARK—Linear Representations of the Lorentz Group 

64, BERMAN—Collection of Problems on a Course of Mathematical Analysis 

65, MESHCHERSKU-—A Collection of Problems of Mechanics 

66. ArscoTt—Periodic Differential Equations 

. 67. SANSONE and Cont1——Non-linear Differential Equations 


Vol. 68. Vo.xovysku, Luntrs and ARAMANOVICH—A Collection of Problems on 


Complex Analysis 


